Skip to content
Change the repository type filter

All

    Repositories list

    • MicroAdam

      Public
      This repository contains code for the MicroAdam paper.
      Python
      Apache License 2.0
      31300Updated Dec 14, 2024Dec 14, 2024
    • PanzaMail

      Public
      Python
      Apache License 2.0
      1526945Updated Dec 9, 2024Dec 9, 2024
    • GridSearcher simplifies running grid searches for machine learning projects in Python, emphasizing parallel execution and GPU scheduling without dependencies on SLURM or other workload managers.
      Python
      Apache License 2.0
      0200Updated Dec 4, 2024Dec 4, 2024
    • EvoPress

      Public
      Python
      11210Updated Dec 3, 2024Dec 3, 2024
    • LLM training code for Databricks foundation models
      Python
      Apache License 2.0
      532001Updated Nov 27, 2024Nov 27, 2024
    • Python
      0000Updated Nov 25, 2024Nov 25, 2024
    • 0000Updated Nov 20, 2024Nov 20, 2024
    • LDAdam

      Public
      LDAdam - Adaptive Optimization from Low-Dimensional Gradient Statistics
      Python
      Apache License 2.0
      0600Updated Nov 6, 2024Nov 6, 2024
    • torch_cgx

      Public
      Pytorch distributed backend extension with compression support
      C++
      GNU Affero General Public License v3.0
      01640Updated Oct 17, 2024Oct 17, 2024
    • Python
      Apache License 2.0
      0700Updated Sep 5, 2024Sep 5, 2024
    • Boosting 4-bit inference kernels with 2:4 Sparsity
      Cuda
      Apache License 2.0
      46110Updated Sep 4, 2024Sep 4, 2024
    • marlin

      Public
      FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.
      Python
      Apache License 2.0
      52653254Updated Sep 4, 2024Sep 4, 2024
    • sparsegpt

      Public
      Code for the ICML 2023 paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot".
      Python
      Apache License 2.0
      98736141Updated Aug 20, 2024Aug 20, 2024
    • peft-rosa

      Public
      A fork of the PEFT library, supporting Robust Adaptation (RoSA)
      Python
      Apache License 2.0
      31310Updated Aug 16, 2024Aug 16, 2024
    • Python
      MIT License
      0000Updated Jun 27, 2024Jun 27, 2024
    • spops

      Public
      C++
      Apache License 2.0
      0620Updated Jun 20, 2024Jun 20, 2024
    • Code for the EMNLP 2024 paper "Mathador-LM: A Dynamic Benchmark for Mathematical Reasoning on LLMs".
      Python
      Apache License 2.0
      0810Updated Jun 18, 2024Jun 18, 2024
    • SPADE

      Public
      Code of SPADE: Sparsity Guided Debugging for Deep Neural Networks
      Jupyter Notebook
      0000Updated May 25, 2024May 25, 2024
    • QUIK

      Public
      Repository for the QUIK project, enabling the use of 4bit kernels for generative inference - EMNLP 2024
      C++
      Apache License 2.0
      1317551Updated Apr 16, 2024Apr 16, 2024
    • FastOBQ-

      Public
      GPTQ with finetuning
      0000Updated Mar 27, 2024Mar 27, 2024
    • gptq

      Public
      Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".
      Python
      Apache License 2.0
      1562k221Updated Mar 27, 2024Mar 27, 2024
    • RoSA

      Public
      Python
      Apache License 2.0
      33510Updated Feb 13, 2024Feb 13, 2024
    • Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
      Python
      Apache License 2.0
      63830Updated Jan 15, 2024Jan 15, 2024
    • CAP

      Public
      Repository for Correlation Aware Prune (NeurIPS23) source and experimental code
      Python
      Apache License 2.0
      1510Updated Nov 29, 2023Nov 29, 2023
    • qmoe

      Public
      Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".
      Python
      Apache License 2.0
      2326230Updated Nov 3, 2023Nov 3, 2023
    • ZipLM

      Public
      Code for the NeurIPS 2023 paper: "ZipLM: Inference-Aware Structured Pruning of Language Models".
      0210Updated Oct 20, 2023Oct 20, 2023
    • TACO4NLP

      Public
      Task aware compression for various NLP tasks
      Python
      0200Updated Oct 9, 2023Oct 9, 2023
    • KDVR

      Public
      Code for the experiments in Knowledge Distillation Performs Partial Variance Reduction, NeurIPS 2023
      Python
      Apache License 2.0
      0100Updated Oct 6, 2023Oct 6, 2023
    • C++
      Apache License 2.0
      41300Updated Sep 27, 2023Sep 27, 2023
    • EFCP

      Public
      The repository contains code to reproduce the experiments from our paper Error Feedback Can Accurately Compress Preconditioners available below:
      Python
      Apache License 2.0
      0400Updated Sep 12, 2023Sep 12, 2023