Original poster here, this got resolved, here is how.

Docker parses the env files in a specific way, so if you have ENVNAME="ENVVALUE" the double quotes get included in the value.

Changing this to ENVNAME=ENVVALUE solved the problem