Code

add llama model support#57

Code

Open

AniZpZ wants to merge 7 commits intomit-han-lab:mainmit-han-lab/smoothquant:mainfrom AniZpZ:llama-devAniZpZ/smoothquant:llama-devCopy head branch name to clipboard

+587

Commits

Commits on Sep 21, 2023

• add int8 llama

  

  zhangpeng

  committed
  ae775d9

  Copy full SHA for ae775d9

• remove debug info

  

  zhangpeng

  committed
  3f8a0d0

  Copy full SHA for 3f8a0d0

• change linears for further fusion

  

  zhangpeng

  committed
  8d19ff0

  Copy full SHA for 8d19ff0

Commits on Sep 26, 2023

• quant fusion

  

  zhangpeng

  committed
  0a26dab

  Copy full SHA for 0a26dab

Commits on Sep 27, 2023

• rm debug code

  

  zhangpeng

  committed
  ab15d59

  Copy full SHA for ab15d59

Commits on Nov 10, 2023

• fix bugs

  

  zhangying169

  committed
  3f063c4

  Copy full SHA for 3f063c4

Commits on Dec 13, 2023

• optimize dequant scale

  

  zhangying169

  committed
  bf6c4c0

  Copy full SHA for bf6c4c0