Looks like its related to using a sub-rule ('\'' expression)
:
'$' currencyExpression? expression ('\'' expression)?
If I change the expression grammar to:
expression
: '$' currencyExpression? expression'\''expression #finAmountWithNB10
| '$' currencyExpression? expression #finAmount
It's now parsing the way I want: