Using the literate key seems to be a sensible, non-hackish approach.

\begin{lstlisting}[literate={£}{\pounds}{1}]
Lorem ipsum 3£
\end{lstlisting}