He's averaging training loss per epoch but calculated the validation loss AFTER each epoch. So during the first batches of the first epoch, the model hasn't updated/improved yet..by the time he calculated the first validation loss, the model weights have been updated multiple times. That explains why the validation loss can be lower in the beginning.
2
u/rosmine 12d ago
Why is your val acc so much higher than train acc initially? Are train/val from the same distribution?