Popular repositories Loading
-
LookaheadDecoding
LookaheadDecoding Public[ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
-
Consistency_LLM
Consistency_LLM Public[ICML 2024] CLLMs: Consistency Large Language Models
-
Repositories
Showing 10 of 11 repositories
- vllm Public Forked from vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
hao-ai-lab/vllm’s past year of commit activity - LookaheadDecoding Public
[ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
hao-ai-lab/LookaheadDecoding’s past year of commit activity - hao-ai-lab.github.io Public
hao-ai-lab/hao-ai-lab.github.io’s past year of commit activity