Have you already tried a higher learning rate? I would maybe go up to 0.02.

And what could also help would be normalizing the data. The values are very high, so for the model the step between 82000 and 90000 is not that big. Maybe try min/max normalization.

Neuronal networks are often try and error - so just try it out and play with the parameters.