Skip to content

Pull requests: ROCm/Megatron-LM

New pull request New
12 Open 51 Closed
12 Open 51 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

ltsabadz/fix dist checkpoint loading fsdp
#63 opened Feb 19, 2025 by ltsabadz Loading…
fix: set missing qkv_bias for Mixtral HF model during conversion
#62 opened Feb 17, 2025 by mpashkovskii • Draft
Update llama data preparation enhancement New feature or request
#61 opened Feb 13, 2025 by nsakkine • Draft
@nsakkine
9
Training Args Fix
#60 opened Feb 13, 2025 by hakankiymaz-amd Loading…
3
Update llama training script and Readme
#59 opened Feb 13, 2025 by vidushi8 Loading…
Fix data preprocessing bug Something isn't working
#58 opened Feb 11, 2025 by nsakkine Loading…
@nsakkine
3
feat: add Grok-1 transformer layer and training scripts
#55 opened Feb 7, 2025 by mpashkovskii • Draft
feat: add LoRA adapter layer and Mixtral LoRA training
#53 opened Jan 31, 2025 by mpashkovskii Loading…
59
[Perf] Skip creating attention mask in llama dataloader
#40 opened Dec 13, 2024 by billishyahao Loading…
3
Make llama dataset preparation more generic.
#32 opened Dec 10, 2024 by lcskrishna Loading…
8
Renwuli/disable te qwen1.5
#27 opened Nov 21, 2024 by amdrenwuli Loading…
1
Renwuli/disable te qwen
#26 opened Nov 21, 2024 by amdrenwuli Loading…
2
ProTip! Mix and match filters to narrow down what you’re looking for.