I know this is stupid, but I traced the issue down to this Chrome extension I had installed years ago: https://chromewebstore.google.com/detail/manage-web-workers/mcojhlgdkpgablplpcfgledhplllmnih?pli=1
I guess a recent Chrome update prompted my browser to re-install that extension after years of having it disabled, and this suddenly broke my app overnight.
You can easily just run the app in incognito to see if that is messing with the web-worker loading. This seemed like such a stupid reason, but in retrospect it makes sense why, despite me doing "all the right things", my issue persisted.
In the offchance someone runs into the same exact issue I had, I figured I'd just document that it could be an issue with installed extensions.