-
Notifications
You must be signed in to change notification settings - Fork 445
Issues: InternLM/lmdeploy
[Benchmark] benchmarks on different cuda architecture with mo...
#815
opened Dec 11, 2023 by
lvhan028
Open
9
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
[Bug] generation profile hangs on Mixtral-8x7B-Instruct-v0.1 with pytorch backend
#2948
opened Dec 24, 2024 by
zhulinJulia24
3 tasks
[Feature] Control over Prefix Cache Capacity and Guaranteed Caching
#2942
opened Dec 23, 2024 by
ZhuQian0909
[Bug] cannot chat with Llama-3.2-11B-Vision-Instruct, because of error 'NoneType' object has no attribute 'kv_seqlens'
#2940
opened Dec 23, 2024 by
zhulinJulia24
3 tasks
[Bug] 请问如何使用自己的数据集进行lmdeploy的awq量化?量化的校对数据集只支持文字问答数据集吗?
#2931
opened Dec 20, 2024 by
lzk9508
3 tasks
[Feature] pipeline.get_logits() support tensor on gpu as input rather than list input
#2926
opened Dec 19, 2024 by
BradZhone
[Feature] how to apply a custom calibration data set during awq quant?
#2923
opened Dec 18, 2024 by
lzk9508
[Bug] notebook量化时torch.OutOfMemoryError: CUDA out of memory.
#2915
opened Dec 17, 2024 by
EvoNexusX
3 tasks
[Bug] vlm模型的聊天模版,只会提取同一个role的最后一段text吗?
awaiting response
#2911
opened Dec 17, 2024 by
OftenDream
3 tasks
[Bug] Same code and enviroment A800 succeed but A10 failed
awaiting response
#2903
opened Dec 17, 2024 by
LaoWangGB
3 tasks done
[Bug] InternLM2.5-20b-chat 长文本推理启动报错
Illegal instruction
#2900
opened Dec 16, 2024 by
simonwei97
3 tasks done
[Feature] Any plans on supporting
deepseek-ai/deepseek-vl2
?
#2897
opened Dec 13, 2024 by
SolomonLeon
[Bug] mixtral moe fp16 greedy decode output differ each request
awaiting response
#2890
opened Dec 13, 2024 by
anaivebird
3 tasks done
Previous Next
ProTip!
What’s not been updated in a month: updated:<2024-11-24.