pytorch/torch/testing
Yanli Zhao d8bafd23ab [DDP] add one option to allow skipping all reduce unused parameters (#151503)
Summary: add one option to allow skipping all reduce unused parameters, this could help improve training throughput significantly when the number of unused parameters is large in the model.

Test Plan: unit tests, CI

Differential Revision: D72282069

Pull Request resolved: https://github.com/pytorch/pytorch/pull/151503
Approved by: https://github.com/mrshenli
2025-04-17 23:30:19 +00:00
..
_internal [DDP] add one option to allow skipping all reduce unused parameters (#151503) 2025-04-17 23:30:19 +00:00
__init__.py [BE][Easy][19/19] enforce style for empty lines in import segments in torch/[o-z]*/ (#129771) 2024-08-01 17:07:14 +00:00
_comparison.py Fix code descriptions in the test package. (#148145) 2025-03-04 19:14:41 +00:00
_creation.py PEP585 update - torch/testing (#145200) 2025-01-20 22:42:42 +00:00
_utils.py Fix code descriptions in the test package. (#148145) 2025-03-04 19:14:41 +00:00