pytorch/torch/distributed/algorithms
Rohan Varma adc9a1e2fb Enforce explicit ProcessGroup passed into DefaultState (#84105)
Would prefer to enforce that users pass in explicit PG into these state objects when using comm hooks with FSDP, so that it is clear and easy debugable over which processes communication is taking place.

Pull Request resolved: https://github.com/pytorch/pytorch/pull/84105
Approved by: https://github.com/mrshenli, https://github.com/zhaojuanmao
2022-08-27 03:12:20 +00:00
..
_checkpoint Generalize CheckpointWrapper (#83035) 2022-08-09 23:35:39 +00:00
_comm_hooks Enforce explicit ProcessGroup passed into DefaultState (#84105) 2022-08-27 03:12:20 +00:00
_optimizer_overlap make fsdp folder to be public (#72084) 2022-02-02 15:50:14 +00:00
_quantization Change docstring type callable to Callable for consistency (#82487) 2022-08-01 17:26:09 +00:00
ddp_comm_hooks Integrate xdoctest - Rebased (#82797) 2022-08-12 02:08:01 +00:00
model_averaging Integrate xdoctest - Rebased (#82797) 2022-08-12 02:08:01 +00:00
__init__.py Make _Join, _Joinable, _JoinHook public (#62605) 2021-08-03 12:20:11 -07:00
join.py Integrate xdoctest - Rebased (#82797) 2022-08-12 02:08:01 +00:00