Skip to content

Pull requests: NVIDIA/Megatron-LM

New pull request New
244 Open 1,203 Closed
244 Open 1,203 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

RL: Fix cu_seqlens construction for PackedSeqParams
#2883 opened Jan 9, 2026 by mathemakitten Loading…
1 of 6 tasks
Core 0.16
1
ci: Remove Github transition comment from CI
#2881 opened Jan 8, 2026 by chtruong814 Loading…
6 tasks
Core 0.16
Test on Muon integration Run CICD
#2880 opened Jan 8, 2026 by BoxiangW Loading…
6 tasks
Core 0.16
6
RL refit pipelining support
#2878 opened Jan 8, 2026 by wdykas Loading…
6 tasks
Core 0.16
3
Fix GPU memory leak during in-process restart
#2875 opened Jan 8, 2026 by ahmadki • Draft
6 tasks
1
handle 'step' state in checkpoint save
#2874 opened Jan 8, 2026 by ahmadki • Draft
6 tasks
1
1
Fix stale parameter index map in DistributedOptimizer
#2872 opened Jan 8, 2026 by ahmadki • Draft
6 tasks
1
1
Add a logprobs test with real gpt model. Expert Review Apply this label to indicate that your PR is ready for expert review.
#2870 opened Jan 8, 2026 by yobibyte Loading…
6 tasks
1
[WIP Feat] Split-K Indexer Kernels community-request
#2869 opened Jan 8, 2026 by laixinn • Draft
7 of 17 tasks
1
Only build datasets on the required ranks
#2865 opened Jan 8, 2026 by asolergi-nv Loading…
1
Remove cross-rank synchronization during checkpoint load & deprecate torch.distributed.checkpoint.state_dict_loader.load_state_dict
#2864 opened Jan 8, 2026 by asolergi-nv Loading…
1
Update Slack user group when oncall changes
#2859 opened Jan 8, 2026 by Phlip79 Loading…
6 tasks
Core 0.16
3
Use global user buffer when the bucket size does not fit FixedPoolAllocator
#2857 opened Jan 7, 2026 by shengf-nv Loading…
6 tasks
1
Initialize M-FSDP Optimizer(DistOpt v2) with DTensor Parameter Support
#2848 opened Jan 7, 2026 by shjwudp • Draft
6 tasks
1
ci: Onboard GB200
#2847 opened Jan 7, 2026 by ko3n1g Loading…
6 tasks
Core 0.16
[Dev] Add Qwen3-VL support with Megatron-FSDP dev branch Dev branch related issues and development
#2842 opened Jan 7, 2026 by xuwchen Loading…
6 tasks
Core 0.16
3
Add Qwen3-VL support with Megatron-FSDP
#2841 opened Jan 7, 2026 by xuwchen Loading…
6 tasks
1
[Dev] Support EP with HSDP community-request
#2840 opened Jan 7, 2026 by wplf Loading…
6 tasks
1
Improve memory logging
#2839 opened Jan 7, 2026 by deepakn94 Loading… Core 0.16
Support DDP overlap for models with repeated parameters
#2837 opened Jan 7, 2026 by deepakn94 Loading… Core 0.16
2
Add retry loop with exponential backoff in dataloader as a form of in-application fault tolerance complexity: low
#2836 opened Jan 7, 2026 by deepakn94 Loading… Core 0.16
5
Cherry-pick optimizer override refactor from #2723
#2835 opened Jan 6, 2026 by yaoyu-33 Loading… Core 0.16
4
Refactor spec modification/introspection to make references to Submodules typed community-request
#2834 opened Jan 6, 2026 by nschank Loading…
6 tasks
5
fsdp: avoid double sharding of MoE experts when EP is enabled community-request Expert Review Apply this label to indicate that your PR is ready for expert review. module: megatron-fsdp
#2833 opened Jan 6, 2026 by CodersAcademy006 Loading…
1
1
Supporting inference when called within an asyncio loop (Pythonic)
#2831 opened Jan 6, 2026 by tdene • Draft
6 tasks
3
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.