Skip to content

Commit 6e4658c

Browse files
authored
[Intel GPU] fix xpu not support punica kernel (which use torch.library.custom_op) (vllm-project#7685)
1 parent 3b68217 commit 6e4658c

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

vllm/lora/punica.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,8 +10,10 @@
1010
import torch
1111

1212
from vllm.triton_utils import HAS_TRITON
13+
from vllm.utils import is_xpu
1314

14-
if HAS_TRITON:
15+
# FIXME: xpu path doesn't support torch.library.custom_op
16+
if HAS_TRITON and not is_xpu():
1517
from vllm.lora.ops.bgmv_expand import bgmv_expand
1618
from vllm.lora.ops.bgmv_expand_slice import bgmv_expand_slice
1719
from vllm.lora.ops.bgmv_shrink import bgmv_shrink

0 commit comments

Comments
 (0)