Supplemental practical concepts · MLD-0874
Parameter count
The number of parameter values in a model or specified component.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Compare model storage requirements before quantization.
Original caveat
Total and active parameters differ in sparsely activated models.
Context and aliases
Level: Intermediate. Stages: Training · Inference · Evaluation.
Tags: ML · DL · LLM · SLM.
Aliases: None recorded.
Related concepts
Concepts linking here
Original references
- Deep Learning: online textbook ↗ · Consulted
- Transformers glossary ↗ · Consulted
- OpenAI Spinning Up: reinforcement learning ↗ · Consulted
- PyTorch documentation ↗ · Reference link
- Original reference URL ↗