AI safety and alignment · MLD-1043

Reward tampering

Interfering with the process, channel, or data used to calculate reward.

Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.

Original example

An agent alters its evaluation input rather than solving the task.

Original caveat

This is a risk category, not evidence that every agent attempts it.

Context and aliases

Level: Advanced. Stages: Training · Evaluation · Research · Governance.

Tags: Safety · RL · SLM · LLM.

Aliases: None recorded.

Related concepts

Concepts linking here

Original references

Open original record, export or annotate →