I was using both kaminari and will_paginate gem. Changing in below configuration fixed my issue

Kaminari.configure do |config|
config.page_method_name = :per_page_kaminari end