Skip to content

Commit

Permalink
fix style
Browse files Browse the repository at this point in the history
  • Loading branch information
rnwang04 committed Dec 5, 2024
1 parent e0a5e39 commit b46ac52
Showing 1 changed file with 2 additions and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -184,7 +184,8 @@ def optimize_llm_pre(model: torch.nn.Module, qtype, mixed_precision,
new_lm_head = SlicedLMHead(model.lm_head.weight, split_num=split_num,
bias=model.lm_head.bias, use_split=True,
group_size=quantization_group_size,
asym=(qtype == "asym_int4_rtn") and (not mixed_precision))
asym=(qtype == "asym_int4_rtn") and
(not mixed_precision))
del model.lm_head
model.lm_head = new_lm_head

Expand Down

0 comments on commit b46ac52

Please sign in to comment.