Index

optimus_dl.modules.lr_scheduler

Modules and Sub-packages

• base: Base configuration for learning rate schedulers.
• cosine_annealing: Configuration for cosine annealing learning rate scheduler.
• linear_warmup: Configuration for linear warmup learning rate scheduler.
• wsd_scheduler: Configuration for WSD (Warmup, Sustain, Decay) learning rate scheduler.