I recently saw a .nsh file for the first time. What is it?

They are scripts that operate in the context of a UEFI shell. ^[1] These tend to have standardised names, like startup.nsh.

I can't find any docs regarding this language. Does anyone know a good place to learn about it?

They appear to adhere to standard POSIX Shell Script syntax.