Regularization and generalization · MLD-0622
Label smoothing
Replacing hard target distributions with less concentrated targets.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Reduce extreme confidence in classification training.
Original caveat
It can hurt tasks requiring precise probability or distillation information.
Context and aliases
Level: Intermediate. Stages: Theory · Training · Evaluation.
Tags: ML · DL · SLM · LLM.
Aliases: None recorded.
Related concepts
Original references
- Deep Learning: online textbook ↗ · Consulted
- Google Machine Learning Glossary ↗ · Consulted
- PyTorch neural-network layers ↗ · Reference link
- Original reference URL ↗