What range of values do your images end up taking? It looks like values between 0 and 256. Best practice is to normalize them between (0,1) or (-1,1), so just divide by 256.
Also could try larger batch size/lower LR as suggested.