The previously suggested solution did not work for me anymore. Instead, setting the environment variable
PMA_ABSOLUTE_URI=https://your.domain.tld/phpmyadmin/
fixed the issue behind a reverse proxy. Tested with phpMyAdmin 5.2.2.