Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[LLM Bench] Added support of OpenVINO pre-releases install and test #1480

Merged

Conversation

ilya-lavrenov
Copy link
Contributor

No description provided.

@ilya-lavrenov ilya-lavrenov added this to the 2025.0 milestone Jan 5, 2025
@github-actions github-actions bot added category: llm_bench Label for tool/llm_bench folder category: GHA CI based on Github actions labels Jan 5, 2025
@@ -1,5 +1,6 @@
--extra-index-url https://download.pytorch.org/whl/cpu
numpy
--extra-index-url https://storage.openvinotoolkit.org/simple/wheels/pre-release
--extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

adding both nightly and pre-release extras does not lead to conflict? Which one will be used by default (first found or last or it depends from platform)?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

adding both nightly and pre-release extras does not lead to conflict?

according to our experiments for GenAI samples - no.
Pip compares packages by version and RC is more "important" than "dev" versions

Which one will be used by default (first found or last or it depends from platform)?

Extra URL indexes are not prioritized somehow and all of them are expedited.

@ilya-lavrenov ilya-lavrenov force-pushed the llm-bench-prerelease branch 2 times, most recently from 1798557 to 33d2810 Compare January 6, 2025 09:12
@github-actions github-actions bot added the category: WWB PR changes WWB label Jan 6, 2025
@ilya-lavrenov ilya-lavrenov added this pull request to the merge queue Jan 6, 2025
@ilya-lavrenov ilya-lavrenov removed this pull request from the merge queue due to a manual request Jan 6, 2025
@ilya-lavrenov ilya-lavrenov merged commit b705155 into openvinotoolkit:master Jan 6, 2025
59 checks passed
@ilya-lavrenov ilya-lavrenov deleted the llm-bench-prerelease branch January 6, 2025 12:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: continuous batching Continuous batching category: GHA CI based on Github actions category: llm_bench Label for tool/llm_bench folder category: visual language Visual language pipeline category: WWB PR changes WWB no-match-files
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants