Bit late to the party but if anyone is stumbling across this post, the issue is with the scaling of Mac OS screens. If you go to displays, and then "Show all resolutions" and select the highest resolution, screen captures will work correctly. Of course, the text becomes really small so not a real workaround.

I cannot figure out yet how to make it work without manually setting the resolution.