add hardware

Signed-off-by: youkaichao <[email protected]>
vllm-project · Dec 11, 2024 · dd24928 · dd24928
1 parent 61ae562
commit dd24928
Showing 1 changed file with 5 additions and 0 deletions.
diff --git a/docs/source/usage/torch_compile.rst b/docs/source/usage/torch_compile.rst
@@ -164,6 +164,11 @@ For multi-modality models, we compile the text-only part of the model from input
 
 By carefully compiling the main computation of the model, we can avoid unnecessary compilation time and achieve better performance.
 
+Supported Hardware
+------------------
+
+Right now ``torch.compile`` is supported on NVIDIA GPUs and AMD GPUs. Google TPUs also use ``torch.compile``, but in a different way.
+
 Feature Compatibility
 ---------------------