Adding 2 rules for conditional formatting before your 'main' conditional formatting, I got this result.
Cell Value < lower limit - no formatting;
Cell Value < lower limit
Cell Value > upper limit - no formatting;
Cell Value > upper limit
Make sure to select 'stop if true' on these first 2 rules.