What was going wrong was: First the buttons didn't have the class swiper-button-next/prev in them, I thought the js would automatically put the corret styling.

Then when I modified the classes to the way they should be, the arrows were in a completely random position, not related to the swiper container, then I just needed to add position: relative to the swiper parent container. Then everything went fine. Thanks for the answers!