pytorch/torch/distributed/algorithms
Yi Wang 2eaf71d749 [Model Averaging] Update model averager API to avoid the redundant params arg needed by post-localSGD optimizer (#62132)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/62132

as title

Proposal: https://github.com/pytorch/pytorch/issues/59699
ghstack-source-id: 134560541

Test Plan:
buck test mode/dev-nosan caffe2/test/distributed:distributed_nccl_fork -- test_post_localSGD_optimizer_parity

buck test mode/dev-nosan caffe2/test/distributed:distributed_nccl_fork -- test_periodic_model_averager

Reviewed By: rohan-varma

Differential Revision: D29887751

fbshipit-source-id: 60dadb04790d800fdcc7cb8a08d060e411718739
2021-07-28 18:43:09 -07:00
..
ddp_comm_hooks [DDP/Functional Optim] Support kwarg arguments (#62079) 2021-07-26 22:12:50 -07:00
model_averaging [Model Averaging] Update model averager API to avoid the redundant params arg needed by post-localSGD optimizer (#62132) 2021-07-28 18:43:09 -07:00
__init__.py [Gradient Compression] Add unit tests that test default Python comm hook implementations (#47158) 2020-11-06 00:28:09 -08:00
join.py Minor documentation fixes (#61785) 2021-07-19 09:01:29 -07:00