Skip to content

perf: avoid full-vocab all-gather for draft greedy sampling - #1517

Merged
sufubao merged 1 commit into
ModelTC:mainfrom
sufubao:exact-vocab-parallel-greedy
Aug 28, 2026
Merged

perf: avoid full-vocab all-gather for draft greedy sampling#1517
sufubao merged 1 commit into
ModelTC:mainfrom
sufubao:exact-vocab-parallel-greedy

Commits

Commits on Aug 28, 2026