pytorch/torch/distributed/algorithms
wayi1 5fbe8b1966 [Model Averaging] Make HierarchicalModelAverager a subclass of averagers.ModelAverager
Make `HierarchicalModelAverager` a subclass of `averagers.ModelAverager` is a preparation step for incorporating hierarchical SGD into `PostLocalSGDOptimizer`.

Proposal: https://github.com/pytorch/pytorch/issues/73382
Pull Request resolved: https://github.com/pytorch/pytorch/pull/74564
Approved by: https://github.com/rohan-varma
2022-03-24 21:52:00 +00:00
..
_checkpoint [Checkpoint] Rename file (#72748) 2022-02-16 00:08:23 +00:00
_optimizer_overlap make fsdp folder to be public (#72084) 2022-02-02 15:50:14 +00:00
ddp_comm_hooks Stop writing logs to root logger (#72649) 2022-02-11 21:30:53 +00:00
model_averaging [Model Averaging] Make HierarchicalModelAverager a subclass of averagers.ModelAverager 2022-03-24 21:52:00 +00:00
quantization [BE] minor improvement to dist quantization (#67401) 2021-11-21 23:31:59 -08:00
__init__.py Make _Join, _Joinable, _JoinHook public (#62605) 2021-08-03 12:20:11 -07:00
join.py [Join][BE] Fix typo; remove obsolete method (#72886) 2022-02-16 15:03:09 +00:00