Fix LAMB norm reduction with ZeRO CPU offload#6431

sdjasj wants to merge 1 commit into

hpcaitech:mainhpcaitech/ColossalAI:mainfrom

sdjasj:agent/fix-lamb-cpu-offload-6400sdjasj/ColossalAI:agent/fix-lamb-cpu-offload-6400Copy head branch name to clipboard