The issue was with ProGuard - even though I didn't have minifyEnabled or shrinkResources enabled to true in the build.gradle file inside the app folder, android was enabling these two configs to true by default.
Setting shrinkResources to false solved the issue.
If you want to keep it enabled to true, you can create a file named proguard-rules.pro file and put this in there: -keep class android.graphics.drawable.Icon { *; }
You can search online for more stuff related to ProGuard issues :)