So for anyone stumbling onto this question in the future I managed to solve it, thanks to a ton of more research. What I had to do is a hard reset of the network config for the host machine:

pkill docker
iptables -t nat -F
ifconfig docker0 down
brctl delbr docker0
ip link del docker0

That's it, after that I ran docker-compose and everything worked.