Index
optimus_dl.modules.data.datasets.strategies
¶
Modules and Sub-packages¶
base: Base class for dataset sampling strategies.concat_random: Treats the dataset as a single concatenated stream of tokens, splits it intodocument: Yields full documents from the dataset.