New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] support LLaVA-NeXT-Video-32B-Qwen #1356

Open

2 tasks done

HarperGG opened this issue Sep 9, 2024 · 2 comments

Open

2 tasks done

[Feature] support LLaVA-NeXT-Video-32B-Qwen #1356

HarperGG opened this issue Sep 9, 2024 · 2 comments

HarperGG commented Sep 9, 2024 •

edited

Loading

Checklist

1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.
2. Please use English, otherwise it will be closed.

Motivation

Hope to support LLaVA-NeXT-Video-32B-Qwen model

Related resources

No response

Member

zhyncs commented Sep 9, 2024

@Luodian May you help take a look

Contributor

merrymercy commented Sep 10, 2024

cc @Luodian @kcz358 @ZhangYuanhan-AI

But I think you can use llava-onevision now.

sglang/test/srt/test_vision_openai_server.py

Line 211 in dff2860

def test_video_chat_completion(self):

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment