Talking about LLMs and the Datasets used for their training, max_length usually indicates the length of the overlapping sequences that get loaded by the DataLoader in a sliding window fashion.
max_length
·30 words·1 min
Talking about LLMs and the Datasets used for their training, max_length usually indicates the length of the overlapping sequences that get loaded by the DataLoader in a sliding window fashion.