From NVIDIA Megatron-LM for visibility #18
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
tests: Disable broken nightly See merge request ADLR/megatron-lm!2011
ci: Improve alerting message See merge request ADLR/megatron-lm!2012
…t's method Co-authored-by: Huy Vu2 <[email protected]>
Updating T5's sharded_state_dict to use parent's method See merge request ADLR/megatron-lm!1991
Add option to skip segment detokenization See merge request ADLR/megatron-lm!1976
Integrate lr scheduler into megatron.core See merge request ADLR/megatron-lm!1385
chore: Add golden values for convergence tests See merge request ADLR/megatron-lm!2014
tests: Disable test_capacity_padding_forward_backward See merge request ADLR/megatron-lm!2016
ci: Better image caching See merge request ADLR/megatron-lm!2018
ci: Create CI branches See merge request ADLR/megatron-lm!2019
ci: H100 for non MR See merge request ADLR/megatron-lm!2020
tests: Stop convergence training See merge request ADLR/megatron-lm!2022
ci: CI on CI-branches only on schedule See merge request ADLR/megatron-lm!2023
ci: Clean nodes See merge request ADLR/megatron-lm!2024
ci: Nicer formatting of notifier See merge request ADLR/megatron-lm!2025
…dMLP distributed checkpointing
Resolve release test failure caused by GroupedMLP distributed checkpointing See merge request ADLR/megatron-lm!2155
tests: Set better name for Wandb logging See merge request ADLR/megatron-lm!2156
Co-authored-by: Xin Yao <[email protected]> Co-authored-by: Deepak Narayanan <[email protected]>
Remove pkg_resources package See merge request ADLR/megatron-lm!1950
ci: Onboard CW See merge request ADLR/megatron-lm!2142
Co-authored-by: Shanmugam Ramasamy <[email protected]> Co-authored-by: Shanmugam Ramasamy <[email protected]>
Small changes to export See merge request ADLR/megatron-lm!2158
Fix rope backward compatibility See merge request ADLR/megatron-lm!2152
[Bug fix] Don't trace graphs during inference See merge request ADLR/megatron-lm!2140
…r_engine, distributed_checkpoint) Co-authored-by: Huy Vu2 <[email protected]>
Adding more MR tests for T5 (e.g., transformer_engine, distributed_checkpoint) See merge request ADLR/megatron-lm!2109
ci: Download artifacts See merge request ADLR/megatron-lm!2164
ci: Bump version See merge request ADLR/megatron-lm!2165
…tstrap backend Co-authored-by: Deepak Narayanan <[email protected]>
Add the interface to set TP communication bootstrap backend See merge request ADLR/megatron-lm!2153
Add support for SigLIP vision encoder to multimodal mcore See merge request ADLR/megatron-lm!2095
Co-authored-by: root <[email protected]> Co-authored-by: Lifu Zhang <[email protected]>
adding cu_seqlens_padded support in MCore See merge request ADLR/megatron-lm!2175
… versions > 1.9 Co-authored-by: Shanmugam Ramasamy <[email protected]>
Fixing attention mask dimenions to support TE versions > 1.9 See merge request ADLR/megatron-lm!2181
rotary_scaling fix for llama3.1 and 3.2 See merge request ADLR/megatron-lm!2180
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.