Pre-training

Type: Concept

A machine learning technique where a model is first trained on a large dataset in an unsupervised or self-supervised manner before being fine-tuned for specific tasks.

Mentioned in 1 podcast episode