Instead of read -s -r -N 1 use read -e -s -r -N 1 call. Here only addition is the -s switch which tells read to use readline library for input and then only read will be able to understand arrow keys and other complex keystrokes.