Django Rest Framework use DjangoModelPermissions on ListAPIView
That's where the answer was, but I did not recognize it at first. So basically, DjangoModelPermissions does not check view_model, and simply allows all GET, OPTION and HEAD requests, regardless of permissions.