The root cause of the issue was that the storage was full. I was able to see that clearly in the AWS RDS console.

Sharing here because there are very little occurrences of this error online and none of them led me to the correct root cause in my case.