Code

Feat outer lr scheduler#20

Code

Draft

samsja wants to merge 15 commits intomainPrimeIntellect-ai/OpenDiloco:mainfrom feat-outer-lr-schedulerPrimeIntellect-ai/OpenDiloco:feat-outer-lr-schedulerCopy head branch name to clipboard

+83-4

Commits

Commits on Aug 22, 2024

• fix torch compile log act (#23)

  Show description for f6748dd
  samsja

  committed
  f6748dd

  Copy full SHA for f6748dd

• add warmup steps

  samsja

  committed
  9d03959

  Copy full SHA for 9d03959

• do not update lr scheduler during warmup

  samsja

  committed
  ac54218

  Copy full SHA for ac54218

• do not update lr scheduler during warmup

  samsja

  committed
  ce6f82b

  Copy full SHA for ce6f82b

• add outer lr scheduler

  samsja

  committed
  e91cbda

  Copy full SHA for e91cbda

• add div by 4

  samsja

  committed
  d0dc44c

  Copy full SHA for d0dc44c

• support none outer lr

  samsja

  committed
  532af19

  Copy full SHA for 532af19

• fix outer lr schedulng

  samsja

  committed
  da41f5b

  Copy full SHA for da41f5b

• fix outer lr schedulng

  samsja

  committed
  16357ca

  Copy full SHA for 16357ca

• update divide

  samsja

  committed
  4ea2735

  Copy full SHA for 4ea2735

• add ckpt for outer schedler

  samsja

  committed
  1e43b47

  Copy full SHA for 1e43b47

• add ckpt for outer schedler

  samsja

  committed
  7328d7d

  Copy full SHA for 7328d7d

• change div

  samsja

  committed
  392a015

  Copy full SHA for 392a015

• remove min olr

  samsja

  committed
  b2b3119

  Copy full SHA for b2b3119

• remove divi

  samsja

  committed
  bf21c13

  Copy full SHA for bf21c13