Mistral model supported by sglang #1344

Closed Answered by 81549361

mikelfried asked this question in Q&A

mikelfried
Sep 6, 2024

Does Mistral Large 2407 supported by sglang?
if so, will it be able to run fp8 version of it?

Thanks!

Answered by 81549361

I tried it, fully supported

View full answer

Replies: 1 comment

81549361
Sep 10, 2024

I tried it, fully supported

0 replies

Answer selected by mikelfried

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment