Skip to content

[TRTLLM-15178][fix] Pad an empty attention-DP scheduled batch so the fleet can make forward progress - #17379

Open
xwang233 wants to merge 6 commits into
NVIDIA:mainfrom
xwang233:fix/adp-empty-scheduled-batch-deadlock
Open

[TRTLLM-15178][fix] Pad an empty attention-DP scheduled batch so the fleet can make forward progress#17379
xwang233 wants to merge 6 commits into
NVIDIA:mainfrom
xwang233:fix/adp-empty-scheduled-batch-deadlock