I know this is 2yrs late, but to other people looking for answer, here's my take.
As someone who's worked with both*(not within the same project),* I strongly recommend you go with PrimeNG, it just offers lots of components that aren't available in Material. Also, I frequently had various styling customization issues with Material unlike PrimeNG where everything is just too smooth and flexible.