Evaluation design and benchmarks · MLD-0529
HumanEval
A code-generation benchmark using programming tasks and tests to assess functional correctness.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Measure sampled Python-solution success.
Original caveat
Passing finite tests is not a complete proof of program correctness.
Context and aliases
Level: Intermediate. Stages: Evaluation · Research.
Tags: ML · DL · LLM · SLM · Safety.
Aliases: None recorded.