For anyone else on this page looking for the answer, I found the answer as recommended by RickN in the comments :)

Replace: const keyBytes = Buffer.from(key, "base64");

With: const keyBytes = Buffer.from(key.trim(), "base64url");