Skip to content

Issues: huggingface/accelerate

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

101 Open 1,512 Closed
101 Open 1,512 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Command line arguments related to deepspeed for accelerate launch do not override those of default_config.yaml
#3203 opened Oct 29, 2024 by JdbermeoUZH
2 of 4 tasks
Problem with metrics calculation and dataloader
#3202 opened Oct 28, 2024 by gssriram
2 of 4 tasks
What should I pass to fsdp_config.fsdp_transformer_layer_cls_to_wrap argument in the yaml file?
#3201 opened Oct 28, 2024 by ShengYun-Peng
2 of 4 tasks
2
Cuda OOM when accelerator.prepare
#3200 opened Oct 25, 2024 by antoinedelplace
2 of 4 tasks
2
Eval loss spikes after resuming from training with DeepSpeed Zero stage 2
#3199 opened Oct 25, 2024 by jubueche
2 of 4 tasks
2
using deepspeed original json config, when using bf16, get the error RuntimeError: expected mat1 and mat2 to have the same dtype, but got: c10::BFloat16 != c10::Half.
#3197 opened Oct 25, 2024 by PMPBinZhang
2 of 4 tasks
Possible issue in Accelerate FSDP Documentation
#3195 opened Oct 24, 2024 by Quicksilver466
1
How to save the optimizer state while enabling Deepspeed to save the model
#3190 opened Oct 23, 2024 by ITerydh
2 of 4 tasks
2
Unable to access model gradients with DeepSpeed and Accelerate
#3184 opened Oct 22, 2024 by shouyezhe
2 of 4 tasks
3
accelerator.prepare() get OOM,but available in single GPU
#3182 opened Oct 21, 2024 by lqf0624
2 of 4 tasks
1
[Bug] The clip_grad_norm of xla fsdp is not right
#3180 opened Oct 21, 2024 by hanwen-sun
4 tasks
Why don't ML engineers use shampoo ?🧴
#3178 opened Oct 18, 2024 by cyber-phys
2
Split_batches argument in Accelerator.__init__ is available, but not used
#3177 opened Oct 17, 2024 by yaraksen
MPI on CPU-only: "no support for _allgather_base"
#3176 opened Oct 17, 2024 by tikhu
2 of 4 tasks
Support --standalone for concurrent single node multi-GPU jobs
#3175 opened Oct 16, 2024 by Olive-Z
Can I load model once or dataset once and copy to subprocess?
#3172 opened Oct 16, 2024 by Hans-digit
1
[Bug] The Transformer Engine plugin seems to be incompatible with LayerNorm that has no weights.
#3171 opened Oct 16, 2024 by IDKiro
2 of 4 tasks
[BUG] Accelerate 1.0.1 failed to train multiple zero-3 models
#3170 opened Oct 15, 2024 by nrailg
2 of 4 tasks
2
[Bug] accelerate ignores TPU
#3169 opened Oct 14, 2024 by steveepreston
1 of 4 tasks
1
dataloader doesn't load data while gpu is training
#3168 opened Oct 14, 2024 by geekifan
2 of 4 tasks
1
save_state() and load_state() do not work correctly with multi-gpu with shuffle=True in dataloader
#3158 opened Oct 11, 2024 by isayoften
2 of 4 tasks
how to load model with fp8 precision for inference?
#3156 opened Oct 11, 2024 by imrankh46
4 tasks done
1
loading big models into memory
#3153 opened Oct 10, 2024 by werruww
2 of 4 tasks
20
Pipeline parallelism examples with Pippy fails
#3151 opened Oct 9, 2024 by goelayu
1 of 4 tasks
@muellerzr
2
Using accelerate launch to initialize sagemaker job doesn't work properly with multiple GPUs
#3148 opened Oct 9, 2024 by BaldPulse
2 of 4 tasks
3
ProTip! What’s not been updated in a month: updated:<2024-09-29.