I added a Serilog debugging log file to the server and got this error, so it turns out it is a certificate issue.

Unable to write 1 log events to the database due to following error: A connection was successfully established with the server, but then an error occurred during the login process. (provider: SSL Provider, error: 0 - The certificate chain was issued by an authority that is not trusted.)