Skip to content

Commit

Permalink
fix profile_generation
Browse files Browse the repository at this point in the history
  • Loading branch information
lvhan028 committed Aug 7, 2024
1 parent 0e744c2 commit 7362d9c
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion benchmark/profile_generation.py
Original file line number Diff line number Diff line change
Expand Up @@ -195,7 +195,7 @@ def profile_throughput(model_path: str, concurrency: int, input_seqlen: int,
f'token_latency percentiles(50%,75%,95%,99%)(s): {percentiles}\n'
f'throughput(output): {out_token_throughput} token/s\n'
f'throughput(total): {total_token_throughput} token/s\n{"-" * 50}')
return tm_model.model_name, \
return model_path, \
[first_token_latency_min, first_token_latency_max,
first_token_latency_ave], \
percentiles, out_token_throughput, total_token_throughput, \
Expand Down

0 comments on commit 7362d9c

Please sign in to comment.