A little late, but better late than never.
You'll have to connect to your database on every request, but you can mitigate the performance overhead by using a connection pooling. For example, Supabase exposes a connection pooler to improve performance. Check to see if your database provider exposes such a connection url or take a look at pgbouncer if you're hosting the database yourself.