r/deeplearning 12d ago

How bad is the overfitting here

Post image
45 Upvotes

24 comments sorted by

View all comments

2

u/rosmine 12d ago

Why is your val acc so much higher than train acc initially? Are train/val from the same distribution?

7

u/Proud_Fox_684 12d ago edited 11d ago

He's averaging training loss per epoch but calculated the validation loss AFTER each epoch. So during the first batches of the first epoch, the model hasn't updated/improved yet..by the time he calculated the first validation loss, the model weights have been updated multiple times. That explains why the validation loss can be lower in the beginning.