Yi Wang acba9b3104 [DDP Communication Hook] Simplify the implementation of parseHookResult of PythonCommHook (#62389) ... Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/62389 Simplify the implementation of `parseHookResult` of `PythonCommHook`, by not directly accepting the output of allreduce, which is a tensor list. Address the comment on https://github.com/pytorch/pytorch/pull/62074#discussion_r675303280 Additionally, formatter is also applied to `OptimizerHookState` and `hook_then_optimizer`. ghstack-source-id: 134626246 Test Plan: buck test mode/dev-nosan caffe2/test/distributed:c10d buck test mode/dev-nosan caffe2/test/distributed:distributed_nccl_fork Reviewed By: rohan-varma Differential Revision: D29982485 fbshipit-source-id: 5b27cc5ef09d2f87c1ade4c0feef7eacc1af3a9a		2021-07-29 17:27:35 -07:00
..
ddp_comm_hooks	[DDP Communication Hook] Simplify the implementation of parseHookResult of PythonCommHook (#62389)	2021-07-29 17:27:35 -07:00
model_averaging	[Model Averaging] Fix docstring of PeriodicModelAverager (#62392)	2021-07-29 17:26:27 -07:00
__init__.py	[Gradient Compression] Add unit tests that test default Python comm hook implementations (#47158)	2020-11-06 00:28:09 -08:00
join.py	Minor documentation fixes (#61785)	2021-07-19 09:01:29 -07:00