LLM training pipeline

Conventional LLM are typically trained in two stages:

• pre-training
• post-training

Some recent research also distinguish a mid-training stage between them.