[WIP]Refine Quantizer 2#2039
Conversation
for more information, see https://pre-commit.ci
…to refine_calib # Conflicts: # auto_round/algorithms/pipeline.py # auto_round/algorithms/quantization/base.py
for more information, see https://pre-commit.ci
|
issue repeated log /home/wenhuach/miniforge3/envs/autoround/bin/python /home/wenhuach/auto-round/auto_round/main.py /models/Qwen3-0.6B --tasks lambada_openai --algs awq,auto-round --seqlen 512 |
|
2 no loss print 2026-07-10 17:02:13 INFO mappings.py L560: AWQ resolved 84 smooth-balance mappings (3 per block × 28 blocks). 3 need to check gradient accumulate step passing correctly 4 refine zero_shot |
for more information, see https://pre-commit.ci
…to refine_calib
for more information, see https://pre-commit.ci
|
|
||
| @torch.no_grad() | ||
| def quantize_block(self, ctx) -> dict: | ||
| def quantize_block(self, block, fp_inputs, input_others, fp_outputs, q_inputs, block_ctx) -> dict: |
There was a problem hiding this comment.
q_inputs default none
1 participant
Description
Please briefly describe your main changes, the motivation.
Type of Change
Bug fix
Related Issues
Fixes or relates to #
Checklist Before Submitting
/azp run Unit-Test-CUDA-AutoRound.