Yi Wang 32b37ba246 [DDP Communication Hook] Update the typing info of comm hook output as well as some docstring (#62457) ... Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/62457 Specify `Future[torch.Tensor]` as DDP communication hook return type, which should be explicitly a single tensor. The previous API takes a list that has a single tensor. Note that now the typing info no longer accepts the internal type of `torch._C.Future`, which does not support torchscript and hence cannot support `Future[torch.Tensor]`. ghstack-source-id: 134771419 Test Plan: buck test mode/dev-nosan caffe2/test/distributed:c10d -- test_default_ddp_comm_hooks_nccl buck test mode/dev-nosan caffe2/test/distributed:c10d -- test_ddp_invalid_comm_hook_return_type Reviewed By: rohan-varma Differential Revision: D30007390 fbshipit-source-id: 246667c9b575b4c6e617b0a5b373151f1bd81e7f		2021-07-30 20:51:34 -07:00
..
ddp_comm_hooks	[DDP Communication Hook] Update the typing info of comm hook output as well as some docstring (#62457)	2021-07-30 20:51:34 -07:00
model_averaging	[Model Averaging] Fix docstring of PeriodicModelAverager (#62392)	2021-07-29 17:26:27 -07:00
__init__.py	[Gradient Compression] Add unit tests that test default Python comm hook implementations (#47158)	2020-11-06 00:28:09 -08:00
join.py	Minor documentation fixes (#61785)	2021-07-19 09:01:29 -07:00