I got it to stop re-rendering by putting the src attribute in a useMemo. I actually put everything that might force a re-rendering in some sort of memo and I think that useMemo for the src was what got it to stop reloading.
src
useMemo
memo