↓ Skip to main content

Notes

2026

Improving Language Understanding by Generative Pre-Training

17 August 2026·5 words·1 min

GPT

17 August 2026·81 words·1 min

few-shot

17 August 2026·22 words·1 min

BERT

17 August 2026·39 words·1 min

Attention Is All You Need

17 August 2026·7 words·1 min

vocabulary

30 May 2026·94 words·1 min

encoding

30 May 2026·63 words·1 min

decoding

30 May 2026·55 words·1 min

BPE

30 May 2026·122 words·1 min

RLHF

15 May 2026·63 words·1 min