Seung-Jae Bang 2d75346c25 [Gradient Compression] Add a minimum compression rate threshold for PowerSGD communication hook (#52541) ... Summary: Fixes #{52034} - Add a minimum compression rate threshold to `PowerSGDState` - Use the threshold to determine whether to compress high-rank tensors or not Pull Request resolved: https://github.com/pytorch/pytorch/pull/52541 Test Plan: No performance regression using rank-8 compression: baseline: f253000411 updated one: f253010955 Reviewed By: rohan-varma Differential Revision: D26594862 Pulled By: SciPioneer fbshipit-source-id: 2859a91b4ca6bd1862bf6cd6441dc2a89badb2d5		2021-02-23 22:03:02 -08:00
..
ddp_comm_hooks	[Gradient Compression] Add a minimum compression rate threshold for PowerSGD communication hook (#52541)	2021-02-23 22:03:02 -08:00
__init__.py	[Gradient Compression] Add unit tests that test default Python comm hook implementations (#47158)	2020-11-06 00:28:09 -08:00