Overfitting

A modeling error where a function is too closely fit to a limited set of data points.

Description

Overfitting occurs when a statistical model or machine learning algorithm captures the noise of the data rather than the underlying pattern. An overfitted model performs well on training data but poorly on unseen data, indicating poor generalization.

Examples

  • ๐Ÿ“Š High accuracy on training data but low accuracy on test data
  • ๐Ÿ” Complex decision boundaries in simple classification tasks

Applications

๐Ÿงช Model evaluation
๐ŸŽ›๏ธ Hyperparameter tuning
๐Ÿ”Ž Feature selection

Related Terms

Featured

Vidnoz AI: Create Free AI Videos in 1 Minute