[Draft] Introduce NVSHMEM based communication API for pytorch#1346

Draft

gdengk wants to merge 3 commits intoNVIDIA:mainfrom gdengk:gaod/nvshmem/p2p-op-pybinding

+260-1

Commits on Nov 22, 2024

working version

Gao Deng
authored and
Gao Deng
committed
add ag collectives
Gao Deng
committed
don't use hard coded path
Gao Deng
committed