Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable modelscope for itrex #1655

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Enable modelscope for itrex #1655

wants to merge 1 commit into from

Conversation

intellinjun
Copy link
Collaborator

@intellinjun intellinjun commented Jul 5, 2024

image
phi2 Fp32 model
image
phi-2-int4-inc

Signed-off-by: intellinjun <[email protected]>
Copy link

github-actions bot commented Jul 5, 2024

⛈️ Required checks status: Has failure 🔴

Warning
If you do not have the access to re-run the CI-Summary bot, please contact VincyZhang for help. If you push a new commit, all of the workflow will be re-triggered.

Groups summary

🔴 Format Scan Tests workflow
Check ID Status Error details
format-scan (pylint) failure download
format-scan (bandit) success
format-scan (cloc) success
format-scan (cpplint) success

These checks are required after the changes to intel_extension_for_transformers/transformers/modeling/modeling_auto.py.

🟢 Optimize Unit Test workflow
Check ID Status Error details
optimize-unit-test-baseline success
optimize-unit-test-PR-test success
Genreate-OptimizeUT-Report success

These checks are required after the changes to intel_extension_for_transformers/transformers/modeling/modeling_auto.py.

🟢 NeuralChat Unit Test
Check ID Status Error details
neuralchat-unit-test-baseline success
neuralchat-unit-test-PR-test success
Generate-NeuralChat-Report success

These checks are required after the changes to intel_extension_for_transformers/transformers/modeling/modeling_auto.py.

🔴 Engine Unit Test workflow
Check ID Status Error details
engine-unit-test-baseline cancelled 🚫
engine-unit-test-PR-test failure download
Genreate-Engine-Report skipped

These checks are required after the changes to intel_extension_for_transformers/transformers/modeling/modeling_auto.py.

🟡 Chat Bot Test workflow
Check ID Status Error details
call-inference-llama-2-7b-chat-hf / inference test no_status
call-inference-mpt-7b-chat / inference test no_status

These checks are required after the changes to intel_extension_for_transformers/transformers/modeling/modeling_auto.py.


Thank you for your contribution! 💜

Note
This comment is automatically generated and will be updates every 180 seconds within the next 6 hours. If you have any other questions, contact VincyZhang or XuehaoSun for help.

@intellinjun
Copy link
Collaborator Author

image
successful inference in client env

Copy link
Contributor

@a32543254 a32543254 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants