I had exactly the same use case and I reached out to Clerk's support.

They responded that this is definitely possible and they pointed me to this blog from Turso: https://turso.tech/blog/why-we-transitioned-to-clerk-for-authentication that gives some hints on how they used Clerk with their CLI.

I haven't tried it myself yet but I thought to share it!