I got feedback from the pyinstaller mailing list to run the build command with --hiddenimport=multiaddr.codecs.idna
After I added that to the build command I got a simmilar error but referencing another library, I added that as well, and now works. I ended up running it like this:
pyinstaller -F --hiddenimport=multiaddr.codecs.idna --hiddenimport=multiaddr.codecs.uint16be --clean apt.py
Thank you!