As I typed this out and looked at the documentation the answer is actually very stupid.
{
"ContainerOverrides": {
"Environment": [
{
"Name": "FILE_NAME",
"Value": "<object_key>"
}
]
}
}
It simply just required Capitalisation of each word