Code

Feat lr scheduler#12

Code

Draft

samsja wants to merge 4 commits intomainPrimeIntellect-ai/OpenDiloco:mainfrom feat-lr-schedulerPrimeIntellect-ai/OpenDiloco:feat-lr-schedulerCopy head branch name to clipboard

+38-4

Commits

Commits on Aug 2, 2024

• add custom lr shedule

  samsja

  committed
  7a334c1

  Copy full SHA for 7a334c1

• add warmup steps

  samsja

  committed
  852b3c5

  Copy full SHA for 852b3c5

• do not update lr scheduler during warmup

  samsja

  committed
  ad82e14

  Copy full SHA for ad82e14

• do not update lr scheduler during warmup

  samsja

  committed
  1869090

  Copy full SHA for 1869090