Data

Collecting, splitting, and balancing datasets.

OversamplingRepeating or creating more examples of a rare class so a dataset is more balanced before training.
Validation setA slice of data kept out of training and used to check the model and tune its settings while you build it.

Basics Training Large language models Evaluation Safety and ethics