Code

Update 2:4 Support#37

Code

Merged

dsikka merged 3 commits intorahul/semi-structuredneuralmagic/vllm:rahul/semi-structuredfrom dipika/sem-struc-uncompneuralmagic/vllm:dipika/sem-struc-uncompCopy head branch name to clipboardDec 6, 2024

+167-210

Commits

Commits on Dec 6, 2024

• remove compressed support; validate against ct models for tp=1,24

  dsikka

  committed
  4e060df

• add testing cases

  dsikka

  committed
  7a6d027

• add support for all cases; update tests

  dsikka

  committed
  0987c98