Skip to content
This repository was archived by the owner on Aug 30, 2024. It is now read-only.

XeTLA INT4 With BF16 Support #311

Merged
merged 2 commits into from
Jul 25, 2024
Merged

XeTLA INT4 With BF16 Support #311

merged 2 commits into from
Jul 25, 2024

Conversation

DDEle
Copy link
Contributor

@DDEle DDEle commented Jul 11, 2024

Type of Change: Feature

API not changed

Description

  1. Fix int4 compile error for bf16 (initially as part of Add zp no degrad dequant #297)
  2. Rename quant_mode, including removing "fullrange" which caused misunderstanding.

Expected Behavior & Potential Risk

N/A

How has this PR been tested?

N/A

Dependency Change?

N/A

Copy link
Contributor

@zhewang1-intc zhewang1-intc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@airMeng
Copy link
Contributor

airMeng commented Jul 11, 2024

@xiaowangintel

@zhewang1-intc
Copy link
Contributor

zhewang1-intc commented Jul 11, 2024

@xiaowangintel

for fp zero point section pls refer to #297 @xiaowangintel

Copy link
Contributor

@a32543254 a32543254 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@DDEle
Copy link
Contributor Author

DDEle commented Jul 25, 2024

Ready to merge as internal IPEX PR merged.

@DDEle DDEle merged commit 9500cb2 into xetla Jul 25, 2024
1 of 4 checks passed
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants