Transformer rope#15775

Draft

ipmedenn wants to merge 5 commits into

NVIDIA-NeMo:mainfrom

ipmedenn:transformer-rope

Commits on Jun 4, 2026

initial commit

authored and
pzelasko
committed
implement review suggestions

authored and
pzelasko
committed
correct docs

authored and
pzelasko
committed

Commits on Jun 5, 2026

Fix CUDA graph stream cleanup on capture errors
pzelasko
committed

Commits on Jun 9, 2026

Adding RoPE to transformer encoder
ipmedenn
committed