Pre-training in AI

The initial phase of training a language model on a massive dataset before honing it for specialized tasks.