The initial phase of training a language model on a massive dataset before honing it for specialized tasks.

Authority Links

A ChatGPT Glossary

Related Terms