I started developing frontend and tried there to login and then call refresh endpoint from browser and it worked, so there must have been some error with postman I think. Now all works as i wanted.