pytorch/torch/distributed/algorithms
wayi1 8b08478115 Fix the doc of PostLocalSGDState (#72792)
Summary:
The first arg of `PostLocalSGDState` ctor, `process_group`, cannot be empty. Here to simplify the usage, does not even create a subgroup explicitly.

See the example in unit test: 4feef6c970/torch/testing/_internal/distributed/distributed_test.py (L4260)

Pull Request resolved: https://github.com/pytorch/pytorch/pull/72792

Reviewed By: samdow

Differential Revision: D34213221

Pulled By: rohan-varma

fbshipit-source-id: 078343f3ee138e175bf835897f190032eb970662
(cherry picked from commit bf90af704f)
2022-02-15 23:47:12 +00:00
..
_checkpoint [FSDP/Checkpoint] Activation offload support in checkpoint_wrapper (#70165) 2021-12-21 10:08:18 -08:00
_optimizer_overlap make fsdp folder to be public (#72084) 2022-02-02 15:50:14 +00:00
ddp_comm_hooks Stop writing logs to root logger (#72649) 2022-02-11 21:30:53 +00:00
model_averaging Fix the doc of PostLocalSGDState (#72792) 2022-02-15 23:47:12 +00:00
quantization [BE] minor improvement to dist quantization (#67401) 2021-11-21 23:31:59 -08:00
__init__.py Make _Join, _Joinable, _JoinHook public (#62605) 2021-08-03 12:20:11 -07:00
join.py #71946 Remove Python 3.6 references (#72211) 2022-02-08 03:46:20 +00:00