So, I got it working.
When I executed the migration from angular to NX monorepo it created tsconfig.app.json and tsconfig.spec.json under apps/my-app/...
I received errors saying "cannot find import path", however I clearly defined everything in the tsconfig.base.json
That is.. well.. I copied tsconfig.app.json and named it tsconfig.json, you know what? It worked..