Xin Yao 8d5d8962ad [Refactor] Replace third_party/nccl with PyTorch's NCCL backend (#4989) ...

* expose GeneratePermutation

* add sparse_all_to_all_push

* add sparse_all_to_all_pull

* add unit test

* handle world_size=1

* remove python nccl wrapper

* remove the nccl dependency

* use pinned memory to speedup D2H copy

* fix lint

* resolve comments

* fix lint

* fix ut

* resolve comments

2023-03-08 12:59:10 +08:00

..

test_nccl.py

[Refactor] Replace third_party/nccl with PyTorch's NCCL backend (#4989)

2023-03-08 12:59:10 +08:00