79554770

Date: 2025-04-04 07:54:34
Score: 2
Natty:
Report link

Answering my own question in case someone stumbles on the same issue:

The problem ended up being a configuration error on my side. The partitions in S3 had zeropadding i.e. April = 04, the projected partitions as can be seen by the glue table parameters do not. I didn't think this would be an issue using the type "integer" but apparently it is.

So the projected partitions would be i.e. month 4, day 3; but in s3 it would be month=04 and day=03 which is the reason Athena couldn't access the data.

Reasons:
  • No code block (0.5):
  • Self-answer (0.5):
  • Low reputation (1):
Posted by: Raisin