Additional mathematical and learning concepts · MLD-0672
Log-sum-exp
The logarithm of a sum of exponentials, often computed by subtracting the largest input for numerical stability.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Normalize log probabilities safely.
Original caveat
Direct exponentiation can overflow even when the final value is representable.
Context and aliases
Level: Intermediate. Stages: Theory · Training · Evaluation.
Tags: ML · DL.
Aliases: LSE.
Related concepts
Concepts linking here
Original references
- Deep Learning: online textbook ↗ · Consulted
- Mathematics for Machine Learning ↗ · Reference link
- scikit-learn User Guide ↗ · Consulted
- Original reference URL ↗