Skip to content
This repository has been archived by the owner on Oct 9, 2024. It is now read-only.

Incorrectly benchmarking #72

Open
JoeyTPChou opened this issue Apr 1, 2023 · 0 comments
Open

Incorrectly benchmarking #72

JoeyTPChou opened this issue Apr 1, 2023 · 0 comments

Comments

@JoeyTPChou
Copy link

All 3 scripts under bloom-inference-scripts incorrectly benchmark the t_generate_span time. The t_generate_span is got from the first generate() call at here https://github.com/huggingface/transformers-bloom-inference/blob/main/bloom-inference-scripts/bloom-ds-inference.py#L257 instead of in the benchmark cycle.
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@JoeyTPChou