pytorch/torch/distributed/algorithms
wayi1 5993f48711 [Model Averaging] Add a reference to hierarchical SGD (#73823)
Summary:
Add a reference.

Also fix the comment: unlike `averagers.py`, currently this is not a base class that can inherit many subclasses.

Pull Request resolved: https://github.com/pytorch/pytorch/pull/73823

Reviewed By: ejguan

Differential Revision: D34684366

Pulled By: rohan-varma

fbshipit-source-id: e253ed39ba0783ad73bfd889e9a2e7d0c9214a3a
(cherry picked from commit a9fec3585078881ccd5886ebb27e52b15f7181b1)
2022-03-08 05:56:17 +00:00
..
_checkpoint [Checkpoint] Rename file (#72748) 2022-02-16 00:08:23 +00:00
_optimizer_overlap make fsdp folder to be public (#72084) 2022-02-02 15:50:14 +00:00
ddp_comm_hooks Stop writing logs to root logger (#72649) 2022-02-11 21:30:53 +00:00
model_averaging [Model Averaging] Add a reference to hierarchical SGD (#73823) 2022-03-08 05:56:17 +00:00
quantization [BE] minor improvement to dist quantization (#67401) 2021-11-21 23:31:59 -08:00
__init__.py Make _Join, _Joinable, _JoinHook public (#62605) 2021-08-03 12:20:11 -07:00
join.py [Join][BE] Fix typo; remove obsolete method (#72886) 2022-02-16 15:03:09 +00:00