[Feat]: Zero-disk hidden-state transfer for specdec streaming via NIXL RDMA#1642

Draft

h-guo18 wants to merge 6 commits into

haoguo/multinode-streamingfrom

haoguo/multinode-streaming-rdma

Commits on Jun 6, 2026

[Feat]: Zero-disk hidden-state transfer for specdec streaming via NIXL RDMA

h-guo18
and
claude
committed
fix(rdma streaming): init round-robin cursor _rr in the RDMA fetch path

h-guo18
and
claude
committed
fix(streaming-rdma): drop pin_memory on trainer recv buffer

h-guo18
and
claude
committed
examples(streaming-rdma): add no-disk RDMA perf-study configs (1s1t / 2s1t / 4s2t)

h-guo18
and
claude
committed
examples(streaming-rdma): add co-located config rdma_1n2g (1 node, 2 GPU)

h-guo18
and
claude
committed
examples(streaming-rdma): add rdma_8s4t (8 serve + 32-rank, 12 nodes)

h-guo18
and
claude
committed