Pinned Loading

1. ggml-org/llama.cpp ggml-org/llama.cpp Public

   LLM inference in C/C++

   C++ 90.9k 14k

2. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 64.7k 11.8k

3. opendatalab/MinerU opendatalab/MinerU Public

   Transforms complex documents like PDFs into LLM-ready markdown/JSON for your Agentic workflows.

   Python 50k 4.1k

4. ggml-org/ggml ggml-org/ggml Public

   Tensor library for machine learning

   C++ 13.7k 1.4k

5. k2-fsa/sherpa-onnx k2-fsa/sherpa-onnx Public

   Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Andr…

   C++ 9.1k 1k

6. intel/ipex-llm intel/ipex-llm Public

   Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discr…

   Python 8.5k 1.4k