After some research I could figure out that for RDS Proxy for some reason you should specify the exact version of your MySQL.