danielhua23 / auto_llm_bench Public

forked from ZJLi2013/auto_llm_bench

Notifications You must be signed in to change notification settings
Fork 0
Star 0

just another bench scripts for llm inference bench among different frameworks & GPUs

0 stars 2 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 9 Commits
serving		serving
trtllm		trtllm
vllm		vllm
README.md		README.md

Repository files navigation

auto_llm_bench

just another bench scripts for llm inference bench among different frameworks & GPUs

About

just another bench scripts for llm inference bench among different frameworks & GPUs

Report repository

Releases

No releases published

Packages

No packages published

Languages

Shell 73.6%
Python 26.4%