mirror of
https://github.com/zebrajr/pytorch.git
synced 2025-12-07 12:21:27 +01:00
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/60303 The util function can be used for averaging parameters. More optimizations can be done in the future. ghstack-source-id: 132214212 Test Plan: buck test mode/dev-nosan caffe2/test/distributed:distributed_nccl_fork -- test_average_parameters buck test mode/dev-nosan caffe2/test/distributed:distributed_gloo_fork -- test_average_parameters Reviewed By: rohan-varma Differential Revision: D29242806 fbshipit-source-id: 76fb5a92adb4bdc6151a9f411e366a0ed2a31f47 |
||
|---|---|---|
| .. | ||
| ddp_comm_hooks | ||
| model_averaging | ||
| __init__.py | ||