I'm late to the party, but we created a proxy to solve this specific use case. Simply create a proxy server, and point it to the RDS proxy. Well, where do you get this magical proxy server that just works?

Here: https://hub.docker.com/r/ambarltd/pgt-proxy

We open sourced this because our customers had to deal with the problem you described!