After researching and testing more, I managed to solve this problem by acquiring Power Automate Premium license from my company and after that removing and importing the package again. This way all flows were turned on automatically after importing was done.

To my understanding majority of the flows required Premium license because they used Dataverse as the trigger.