Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

sglang for Qwen2.5-14b deploy Error #2520

Open
wuxianyess opened this issue Dec 19, 2024 · 1 comment
Open

sglang for Qwen2.5-14b deploy Error #2520

wuxianyess opened this issue Dec 19, 2024 · 1 comment
Assignees

Comments

@wuxianyess
Copy link

Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/sgl-workspace/sglang/python/sglang/launch_server.py", line 14, in
launch_server(server_args)
File "/sgl-workspace/sglang/python/sglang/srt/server.py", line 526, in launch_server
launch_engine(server_args=server_args)
File "/sgl-workspace/sglang/python/sglang/srt/server.py", line 488, in launch_engine
tokenizer_manager = TokenizerManager(server_args, port_args)
File "/sgl-workspace/sglang/python/sglang/srt/managers/tokenizer_manager.py", line 109, in init
self.model_config = ModelConfig(
File "/sgl-workspace/sglang/python/sglang/srt/configs/model_config.py", line 93, in init
self.hf_text_config.hidden_size // self.hf_text_config.num_attention_heads,
File "/usr/local/lib/python3.10/dist-packages/transformers/configuration_utils.py", line 210, in getattribute
return super().getattribute(key)
AttributeError: 'InternVLChatConfig' object has no attribute 'hidden_size'

@wuxianyess
Copy link
Author

Can sglang support internvl model?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants