How many H20 (96GB) GPUs are needed to train Qwen7B with the GRPO algorithm?

[Tuziking]

I want to use the GRPO algorithm to train Qwen7B, but I failed using 4 H20 (96GB) GPUs with the trl library. I hope to train it with the verl library and would like to know how many H20 GPUs are needed.

[vermouth1992]

I think 4 should be enough.

[Tuziking]

I think 4 should be enough.我认为 4 个应该足够了。

Thank you, I will try!