pytorch/torch/lib
Yi Wang 5a962369e2 [Gradient Compression] Check if the backend is NCCL when a DDP communication hook is registered (#51759)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/51759

Some unit tests actually register a comm hook on other backends like GLOO. Example: `test_ddp_comm_hook_future_passing_cpu`

Therefore, only do the check on `register_builtin_comm_hook`.

Currently DDP communication hook can only be supported on NCCL. Add a check in the registration methods.
ghstack-source-id: 121115814

Test Plan: unit tests.

Reviewed By: pritamdamania87

Differential Revision: D26268581

fbshipit-source-id: c739fa4dca6d320202dc6689d790c2761c834c30
2021-02-05 09:59:12 -08:00
..
c10d [Gradient Compression] Check if the backend is NCCL when a DDP communication hook is registered (#51759) 2021-02-05 09:59:12 -08:00
libshm [cmake] add HAVE_SOVERSION option (default=OFF). (#37502) 2020-04-30 06:52:33 -07:00
libshm_windows CMake script cleanup - mixed case for function names (#35589) 2020-03-30 11:37:02 -07:00