The best course of action was to skip using a CollisionPolygon2D at all and instead just check Geometry2D.is_point_in_polygon(pos, polygon.polygon) on the visual Polygon2D. Where pos is the position of the mouse.
CollisionPolygon2D
Geometry2D.is_point_in_polygon(pos, polygon.polygon)
Polygon2D
pos