Skip to content

Does vllm disaggregated prefilling supports to run multiple model in one single host (with 8 GPUs) ? #14615

Colstuwjx announced in Q&A

You must be logged in to vote

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
1 participant