Data and feature engineering · MLD-0266
Data mixture
The proportions and sampling rules used to combine datasets or domains.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Mix code, math, and general text during pretraining.
Original caveat
Raw dataset size and sampling frequency need not match.
Context and aliases
Level: Intermediate. Stages: Data · Training · Evaluation.
Tags: ML · DL · SLM · LLM.
Aliases: None recorded.
Related concepts
Concepts linking here
Original references
- scikit-learn: cross-validation ↗ · Reference link
- scikit-learn: missing-value imputation ↗ · Reference link
- scikit-learn: preprocessing ↗ · Reference link
- scikit-learn: feature selection ↗ · Reference link
- Original reference URL ↗