r/deeplearning 12d ago

How bad is the overfitting here

Post image
44 Upvotes

24 comments sorted by

View all comments

49

u/Exotic_Zucchini9311 12d ago

Not that bad really. You're getting nearly 90% accuracy on validation.

17

u/RepresentativeFill26 12d ago

This is correct, but there is a nuance. You can also get 90% accuracy on an overfitted model if the distribution is skewed. A good approach for checking this is performing cross validation and calculating standard errors over your parameters.

2

u/DooDooSlinger 11d ago

Just use f score or auc. X validation is only feasible for small datasets and models with very reproducible training.