[QUESTION]How to setup fp8 trainging using Megatron-LM #1250
Unanswered
yanchenmochen
asked this question in
Q&A
Replies: 1 comment
-
Is FP8 training compatible with recompute? |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Your question
Ask a clear and concise question about Megatron-LM.
Beta Was this translation helpful? Give feedback.
All reactions