Your U-Net model is overfitting likely due to a limited dataset or insufficient regularization. In addition to data augmentation, try these steps:
Use dropout layers in the encoder and decoder.
Apply L2 regularization on convolution layers.
Reduce the model complexity (e.g., fewer filters per layer).
Implement early stopping based on validation loss.
Consider using a pre-trained encoder (e.g., ResNet as backbone).
Also, ensure your validation set is truly representative and not too small.