Evaluation metrics and uncertainty · MLD-0389
Expected calibration error
A binned summary of differences between predicted confidence and empirical correctness or frequency.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Summarize confidence calibration.
Original caveat
ECE is sensitive to binning and can miss localized miscalibration.
Context and aliases
Level: Intermediate. Stages: Evaluation · Research.
Tags: ML · DL · SLM · LLM.
Aliases: ECE.
Related concepts
Concepts linking here
Original references
- scikit-learn: cross-validation ↗ · Reference link
- Google Machine Learning Glossary ↗ · Consulted
- scikit-learn: evaluation metrics ↗ · Reference link
- Original reference URL ↗