New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

--mixed_precision=fp16 #65

Open

WGS-note opened this issue May 11, 2023 · 2 comments

WGS-note commented May 11, 2023

多卡训练需要去掉混合精度，否则会：RuntimeError: expected scalar type Half but found Float，因为模型是Half加载的

starphantom666 commented May 11, 2023

用p-tuning还是lora做的，lora多卡我都跑不起来，量化直接报错

pengcao commented Sep 2, 2023

我没有用--mixed_precision=fp16没有报错

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment