Skip to main content

pre-training

·85 words·1 min
Dave the human
Author
Dave the human
Homo sapiens in the loop

During pre-training the Large Language Model learns general patterns, grammar, and facts from the internet/books via self-supervised learning. At this stage, the objective for the LLM is to learn to predict the next word (or token) in these texts.

We can think of this stage as “raw language prediction” that gives the LLM basic capabilities to produce coherent texts.

A model that has completed the pre-training stage is often called a base model or a foundation model and a typical example is the GPT-3 model.


 LLM post-training 

Comments