Pinned Loading

1. vllm-project/llm-compressor vllm-project/llm-compressor Public

   Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

   Python 668 54

2. neuralmagic/compressed-tensors neuralmagic/compressed-tensors Public

   A safetensors extension to efficiently store sparse quantized tensors on disk

   Python 46 1

3. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 30.1k 4.5k