Pinned Loading

1. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python

2. Verifier-Guided-Speculative-Decoding Verifier-Guided-Speculative-Decoding Public

   multiple tokens, and a verifier filters them using the main model’s confidence. Focuses on speed–accuracy tradeoffs, visualization, and modular design for easy benchmarking and research.

   Jupyter Notebook

3. ScanAI ScanAI Public

   ScanAI is a React app that analyzes product ingredients across food, cosmetics, and household items. Create a profile with allergens, scan or search products, and get clear safe/unsafe indicators w…

   JavaScript

4. triton-fast-mha triton-fast-mha Public

   A high-performance kernel implementation of multi-head attention using Triton. Focused on minimizing memory overhead and maximizing throughput for large-scale transformer layers. Includes clean-ten…

   Python

5. RTGX-Real-Time-Glossary-eXplainer RTGX-Real-Time-Glossary-eXplainer Public

   RTGX is an AI-powered real-time glossary explainer that adds contextual subtitles during live lectures. It transcribes speech, identifies complex terms, and provides instant, context-aware definiti…

   JavaScript

6. Mastering-LLMs Mastering-LLMs Public

   A curated workshop of Jupyter notebooks and deep-dive PDFs that break down how large language models work , from kv-cache internals and fine-tuning to optimization strategies and skill paths. Ideal…

   Jupyter Notebook 1 1