Skip to content

Commit

Permalink
fix rollout test to 2GPU
Browse files Browse the repository at this point in the history
  • Loading branch information
PeterSH6 committed Dec 7, 2024
1 parent 7425b36 commit 23cffb4
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion tests/rollout/test_vllm_hf_loader.py
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@


def test_vllm_with_hf():
assert torch.cuda.device_count() >= 4, 'At least 4 GPUs is required to run tp+dp tests.'
assert torch.cuda.device_count() >= 2, 'At least 2 GPUs is required to run tp+dp tests.'

# fill rollout config
max_prompt_length = 16
Expand Down

0 comments on commit 23cffb4

Please sign in to comment.