Skip to content

Index

optimus_dl.modules.data.datasets.strategies

Modules and Sub-packages

  • base: Base class for dataset sampling strategies.
  • concat_random: Treats the dataset as a single concatenated stream of tokens, splits it into
  • document: Yields full documents from the dataset.