Reinforcement learning · MLD-0836
Offline reinforcement learning
Learning a policy from a fixed dataset without collecting new environment interactions during training.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Use historical interaction logs.
Original caveat
Unsupported actions can lead to severe extrapolation errors.
Context and aliases
Level: Intermediate. Stages: Theory · Training · Evaluation.
Tags: RL · DL · SLM · LLM.
Aliases: Batch RL.
Related concepts
Original references
- OpenAI Spinning Up: reinforcement learning ↗ · Consulted
- TRL documentation ↗ · Consulted
- Original reference URL ↗