Pinned Loading

1. LeetCUDA LeetCUDA Public

   📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA/Tensor Cores Kernels, HGEMM, FA-2 MMA.

   Cuda 4.8k 527

2. lite.ai.toolkit lite.ai.toolkit Public

   🛠 A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion, etc.🎉

   C++ 4.1k 745

3. Awesome-LLM-Inference Awesome-LLM-Inference Public

   📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.

   Python 4.1k 287

4. Awesome-DiT-Inference Awesome-DiT-Inference Public

   📚A curated list of Awesome Diffusion Inference Papers with Codes: Sampling, Caching, Quantization, Parallelism, etc.

   Python 276 16

5. torchlm torchlm Public

   💎An easy-to-use PyTorch library for face landmarks detection: training, evaluation, inference, and 100+ data augmentations.

   Python 259 24

6. ffpa-attn ffpa-attn Public

   ⚡️FFPA: Extend FlashAttention-2 with Split-D, achieve ~O(1) SRAM complexity for large headdim, 1.8x~3x↑ vs SDPA.

   Cuda 186 8