If you are using iterm2 or similar terminal, just uncheck the following functionality.
Scroll wheel sends arrow keys when in alternate screen mode.