Looks like an 8.0.40 problem. I ran into the same error message about
Authentication Plugin '' cannot be loaded
This was on a new workstation with a completely clean install of MySQL Workbench 8.0.40 via MSI installer, using TCP/IP over SSH for connection to the server.