pytorch/torch/csrc/distributed
Tristan Rice 9f4f061f89 PyProcessGroup: support rank, world size, group name/desc overrides (#141529)
This improves `PyProcessGroup` so you can override rank, world size and group name/desc methods from Python. These will be needed to support resizable process groups in torchft.

This also has some small fixes in test_c10d_pypg.py to use threads instead of processes which speeds up the test execution by ~10x.

Test plan:

```
pytest test/distributed/test_c10d_pypg.py
```

Pull Request resolved: https://github.com/pytorch/pytorch/pull/141529
Approved by: https://github.com/fegin
2024-11-26 20:56:57 +00:00
..
autograd Use Wextra-semi (#140236) 2024-11-13 02:15:16 +00:00
c10d PyProcessGroup: support rank, world size, group name/desc overrides (#141529) 2024-11-26 20:56:57 +00:00
rpc [12/N] Fix extra warnings brought by clang-tidy-17 (#140801) 2024-11-15 16:54:30 +00:00