As mentioned in a comment/reply to @Christoph, I finally gave up and added the -rtsp_transport tcp flag to the command line.

This has improved reliability immensely! Whereas in the original situation I couldn't get a decent image for more than a minute (at best!), now the images are perfect and crystal clear all of the time.