You can simply create a WAF rule in clowdflare that skip all filters for traffic from your VPS IP. Note that you may need to include both IPv4 and IPv6.