Nothing like a good night of sleep...
I was able to solve this issue with a bit of help. As expected, pydub is calling internally ffmpeg, so I have to rather to add it in the path manually via `os`, that is:
os.environ["PATH"] = ffmpeg_dir + os.pathsep + os.environ.get("PATH", "")
And there you go!