「 I'm a software developer from China 」
「 Focused on Large Language Model (LLM) inference 」
Pinned Loading
-
sglang
sglang PublicForked from sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
Python
-
Mooncake
Mooncake PublicForked from kvcache-ai/Mooncake
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
C++
-
FastDeploy
FastDeploy PublicForked from PaddlePaddle/FastDeploy
High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle
Python
-
DeepEP
DeepEP PublicForked from deepseek-ai/DeepEP
DeepEP: an efficient expert-parallel communication library
Cuda
Something went wrong, please refresh the page to try again.
If the problem persists, check the GitHub status page or contact support.
If the problem persists, check the GitHub status page or contact support.
