Yes, it definitely does. But it depends on how the popups are implemented. You should be fine if you use the defer
keyword to load javascript.
I recommend you use optimized images and assets of low size as popup content to keep it fast.
You can find more on this detailed case study here - https://www.poper.ai/blog/popups-affect-your-websites-speed/