It was because of the sign_out link was using get instead of delete

  devise_for :users, controllers: { sessions: 'users/sessions' }, sign_out_via: [:delete, :get]

Will fix the isue.