pytorch/torch/distributed/algorithms
Rohan Varma 1a53e35b9d Enforce explicit ProcessGroup passed into DefaultState (#84105)
Would prefer to enforce that users pass in explicit PG into these state objects when using comm hooks with FSDP, so that it is clear and easy debugable over which processes communication is taking place.

Pull Request resolved: https://github.com/pytorch/pytorch/pull/84105
Approved by: https://github.com/mrshenli, https://github.com/zhaojuanmao
2022-08-29 14:52:58 +00:00
..
_checkpoint Generalize CheckpointWrapper (#83035) 2022-08-09 23:35:39 +00:00
_comm_hooks Enforce explicit ProcessGroup passed into DefaultState (#84105) 2022-08-29 14:52:58 +00:00
_optimizer_overlap make fsdp folder to be public (#72084) 2022-02-02 15:50:14 +00:00
_quantization Change docstring type callable to Callable for consistency (#82487) 2022-08-01 17:26:09 +00:00
ddp_comm_hooks Integrate xdoctest - Rebased (#82797) 2022-08-12 02:08:01 +00:00
model_averaging Integrate xdoctest - Rebased (#82797) 2022-08-12 02:08:01 +00:00
__init__.py
join.py Integrate xdoctest - Rebased (#82797) 2022-08-12 02:08:01 +00:00