Training on davethehuman.com

batch

Sun, 20 Sep 2026 00:00:00 +0000

The batch is the sample used to perform a single forward pass and backward pass before the model updates its weights. The model training is strongly influenced by the batch size.

batch size

Sun, 20 Sep 2026 00:00:00 +0000

Batch size refers to the number of training examples processed in a batch, which corresponds to a single forward pass and backward pass before the model updates its weights.

For instance, if a dataset contains 10,000 images and the batch size is set to 64, the model splits the dataset into subsets of 64 images, calculates the average error (loss) across those 64 samples, updates its weights, and then moves to the next batch.

self-supervised learning

Mon, 17 Aug 2026 00:00:00 +0000

LLMs use self-supervised learning, where the model generates its own labels from the input data (as opposed to the conventional supervised learning paradigm).