If you're working on a Chrome extension like me and run into this issue, make sure the source map is in web_accessible_resources in the manifest.
web_accessible_resources