I don't' think the popular geometric shadowing terms behave correctly with negative numbers. It's typical to clamp the ndots before passing them to the geometry terms, but geometry doesn't just go away because it goes into shadow. It' better to make the geometry functions work correctly with negative numbers. What I did was just save the sign of the ndot inputs and then work on the abs of them. Then restore the sign at the output. Simple but effective.