Skip to content

perf: avoid full-vocab gather for greedy sampling - #1511

Closed
sufubao wants to merge 1 commit into
ModelTC:mainfrom
sufubao:vocab-parallel-greedy
Closed

perf: avoid full-vocab gather for greedy sampling#1511
sufubao wants to merge 1 commit into
ModelTC:mainfrom
sufubao:vocab-parallel-greedy

Commits

Commits on Aug 26, 2026