Skip to content

Commit

Permalink
add xpu triton in dockerfile, or will show "Could not import Flash At… (
Browse files Browse the repository at this point in the history
#2702)

add xpu triton in dockerfile, or will show "Could not import Flash Attention enabled models: No module named 'triton'"

Signed-off-by: Wang, Yi A <[email protected]>
  • Loading branch information
sywangyi authored Oct 30, 2024
1 parent 98330df commit 46aeb08
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions Dockerfile_intel
Original file line number Diff line number Diff line change
Expand Up @@ -93,6 +93,7 @@ ENV HF_HOME=/data \

WORKDIR /usr/src
RUN pip install torch==2.3.1+cxx11.abi torchvision==0.18.1+cxx11.abi torchaudio==2.3.1+cxx11.abi intel-extension-for-pytorch==2.3.110+xpu oneccl_bind_pt==2.3.100+xpu --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/ --no-cache-dir
RUN pip install triton-xpu==3.0.0b2 --no-cache-dir

# Install server
COPY proto proto
Expand Down

0 comments on commit 46aeb08

Please sign in to comment.