Skip to content

Releases: AniZpZ/AutoSmoothQuant

Release v0.0.2

01 Feb 10:01
Compare
Choose a tag to compare
Release v0.0.2 Pre-release
Pre-release

Add models: Mixtral and Baichuan 7B.
Optimization: Simplified quant config, all models share the same config format now.
Bug Fix: 1. Fix bugs in quantizing Llama2(when pretrain_tp>1). 2. Fix bugs in Opt Inference.