Skip to content
This repository has been archived by the owner on Oct 25, 2024. It is now read-only.

add FP8Config #1442

Open
wants to merge 3 commits into
base: main
Choose a base branch
from
Open

add FP8Config #1442

wants to merge 3 commits into from

Conversation

mengniwang95
Copy link
Collaborator

Type of Change

feature

Description

do FP8 quantization using habana

Expected Behavior & Potential Risk

the expected behavior that triggered by this PR

How has this PR been tested?

how to reproduce the test (including hardware information)

Dependency Change?

any library dependency introduced or removed

@mengniwang95
add FP8Config
0f4ecd9 
Signed-off-by: Mengni Wang <[email protected]>
@github-actions GitHub Actions
Copy link

github-actions bot commented Apr 1, 2024 •
edited
Loading

⛈️ Required checks status: Has failure 🔴

Warning
If you do not have the access to re-run the CI-Summary bot, please contact VincyZhang for help. If you push a new commit, all of the workflow will be re-triggered.

Groups summary

🔴 Format Scan Tests workflow
Check ID Status Error details
format-scan (pylint) failure download ❌
format-scan (bandit) success ✅
format-scan (cloc) success ✅
format-scan (cpplint) success ✅

These checks are required after the changes to intel_extension_for_transformers/transformers/__init__.py, intel_extension_for_transformers/transformers/modeling/modeling_auto.py, intel_extension_for_transformers/transformers/utils/__init__.py, intel_extension_for_transformers/transformers/utils/config.py.

🔴 Optimize Unit Test workflow
Check ID Status Error details
optimize-unit-test-baseline success ✅
optimize-unit-test-PR-test failure download ❌
Genreate-OptimizeUT-Report skipped ❓

These checks are required after the changes to intel_extension_for_transformers/transformers/__init__.py, intel_extension_for_transformers/transformers/modeling/modeling_auto.py, intel_extension_for_transformers/transformers/utils/__init__.py, intel_extension_for_transformers/transformers/utils/config.py.

🔴 NeuralChat Unit Test
Check ID Status Error details
neuralchat-unit-test-baseline success ✅
neuralchat-unit-test-PR-test failure download ❌
Generate-NeuralChat-Report skipped ❓

These checks are required after the changes to intel_extension_for_transformers/transformers/__init__.py, intel_extension_for_transformers/transformers/modeling/modeling_auto.py, intel_extension_for_transformers/transformers/utils/__init__.py, intel_extension_for_transformers/transformers/utils/config.py.

🔴 Engine Unit Test workflow
Check ID Status Error details
engine-unit-test-baseline cancelled 🚫
engine-unit-test-PR-test failure download ❌
Genreate-Engine-Report skipped ❓

These checks are required after the changes to intel_extension_for_transformers/transformers/__init__.py, intel_extension_for_transformers/transformers/modeling/modeling_auto.py, intel_extension_for_transformers/transformers/utils/__init__.py, intel_extension_for_transformers/transformers/utils/config.py.

🟢 Chat Bot Test workflow
Check ID Status Error details
call-inference-llama-2-7b-chat-hf / inference test success ✅
call-inference-mpt-7b-chat / inference test success ✅

These checks are required after the changes to intel_extension_for_transformers/transformers/__init__.py, intel_extension_for_transformers/transformers/modeling/modeling_auto.py, intel_extension_for_transformers/transformers/utils/__init__.py, intel_extension_for_transformers/transformers/utils/config.py.

Thank you for your contribution! 💜

Note
This comment is automatically generated and will be updates every 180 seconds within the next 6 hours. If you have any other questions, contact VincyZhang or XuehaoSun for help.

@mengniwang95
Update modeling_auto.py
3a3568c 
Signed-off-by: Wang, Mengni <[email protected]>
@mengniwang95
Copy link
Collaborator Author

@ftian1 @kevinintel @xin3he @PenghuiCheng please review this PR

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers

@PenghuiCheng PenghuiCheng Awaiting requested review from PenghuiCheng PenghuiCheng is a code owner

@ftian1 ftian1 Awaiting requested review from ftian1

@thuang6 thuang6 Awaiting requested review from thuang6

@xin3he xin3he Awaiting requested review from xin3he

@kevinintel kevinintel Awaiting requested review from kevinintel

At least 2 approving reviews are required to merge this pull request.

Assignees
No one assigned
Labels
habana
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@mengniwang95 @VincyZhang