Turns out I had to switch to Asymetric Signing keys in the Supabase dashboard by disabling the legacy secrets.