Overfitting

A modeling error where a function is too closely fit to a limited set of data points.

Description

Overfitting occurs when a statistical model or machine learning algorithm captures the noise of the data rather than the underlying pattern. An overfitted model performs well on training data but poorly on unseen data, indicating poor generalization.

Examples

  • πŸ“Š High accuracy on training data but low accuracy on test data
  • πŸ” Complex decision boundaries in simple classification tasks

Applications

πŸ§ͺ Model evaluation
πŸŽ›οΈ Hyperparameter tuning
πŸ”Ž Feature selection

Related Terms