Route decode-only skip-softmax through the decode kernel in vLLM#1634
Draft
kaix-nv wants to merge 2 commits into
Draft
Route decode-only skip-softmax through the decode kernel in vLLM#1634kaix-nv wants to merge 2 commits into
kaix-nv wants to merge 2 commits into