Skip to content

Commit

Permalink
fix ut
Browse files Browse the repository at this point in the history
  • Loading branch information
lvhan028 committed Jul 23, 2024
1 parent 0402ae3 commit fd514e2
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion lmdeploy/turbomind/deploy/converter.py
Original file line number Diff line number Diff line change
Expand Up @@ -111,7 +111,7 @@ def get_output_model_registered_name_and_config(model_path: str,
weight_type = 'int4'
register_name = 'plora-w4' \
if turbomind_model_arch == 'xcomposer2' else 'w4'
# group_size = 128 if group_size == 0 else group_size
group_size = 128 if group_size == 0 else group_size
else:
torch_dtype = getattr(model_config, 'torch_dtype', 'float16')
TORCH_DTYPE_MAP = {torch.bfloat16: 'bf16', torch.float16: 'fp16'}
Expand Down

0 comments on commit fd514e2

Please sign in to comment.