New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Is there multi-gpu suport? #1

Open

008karan opened this issue Mar 17, 2020 · 2 comments

008karan commented Mar 17, 2020

Have checked official repo but thats on single gpu. Do this Repo provide multi-gpu support?

miketrimmel commented May 16, 2020

If you´re looking in the source code, yes there is.

electra_pytorch/run_pretraining.py

Line 187 in 1199255

if args.local_rank == -1 or args.no_cuda:

Hanlard commented Jul 11, 2020

支持多个GPU，但是会出现主GPU显存使用率不均衡的问题

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment