I found the answer. I work with python only, so in the annotations window I unchecked all boxes for 'breakpoint' (not python) and checked the vertical ruler box for python breakpoint and selected yellow.

To test it, I checked the vertical ruler box for breakpoint (not python). The icon started showing when clicked.