I couldn't get any of the solutions here to work and ended up just overriding the minimum log level for all Polly events in Serilog, e.g.:

var loggerConfig = new LoggerConfiguration()
    .MinimumLevel.Override("Polly", LogEventLevel.Warning);
Log.Logger = loggerConfig.CreateBootstrapLogger();