Evaluation design and benchmarks · MLD-0382

Evaluation variance

Variation in measured results caused by sample choice, random seeds, generation, or judging.

Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.

Original example

Repeat evaluations to estimate uncertainty in model comparisons.

Original caveat

A single score can conceal substantial uncertainty.

Context and aliases

Level: Intermediate. Stages: Evaluation · Research.

Tags: ML · DL · LLM · SLM · Safety.

Aliases: None recorded.

Related concepts

Concepts linking here

Original references

Open original record, export or annotate →