I couldn't solve this problem directly, with I got a solution that works. The validation dataset is a smaller portion of the total dataset. In this case I loaded it complete in memory (I didn't use a generator). Validation has worked in all epochs.