Thanks alot to @kissu. The resolution is to refer to the .mjs file directly
import * as Dexie from 'dexie/dist/dexie.mjs';