Popular repositories Loading

1. hnet hnet Public

   H-Net: Hierarchical Network with Dynamic Chunking

   Python 661 63

2. hydra hydra Public

   Official implementation of "Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers"

   Python 154 12

3. phi-mamba phi-mamba Public

   Official implementation of Phi-Mamba. A MOHAWK-distilled model (Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Models)

   Python 114 10

4. Gather-and-Aggregate Gather-and-Aggregate Public

   Experiments Notebook of "Understanding the Skill Gap in Recurrent Language Models: The Role of the Gather-and-Aggregate Mechanism"

   Python 12 2

5. goombalab.github.io goombalab.github.io Public

   HTML 2 1