Decoding and inference behavior · MLD-1207
Target model
The model whose output distribution or behavior a speculative system aims to preserve.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Verify draft token proposals.
Original caveat
Target can have different meanings in other training contexts.
Context and aliases
Level: Intermediate. Stages: Inference · Evaluation · Deployment.
Tags: SLM · LLM · NLP.
Aliases: None recorded.
Related concepts
Concepts linking here
Original references
- Hugging Face: generation strategies ↗ · Reference link
- Fast Inference from Transformers via Speculative Decoding ↗ · Consulted
- vLLM documentation ↗ · Consulted
- Original reference URL ↗