预训练

Training a model on massive unlabeled text to learn language patterns.

Pretraining gives models grammar, knowledge and reasoning foundations—the "base" of capability. It is extremely expensive (GPU clusters, months) and usually done by vendors; users fine-tune on top or call APIs.