OSSForks/pytorch
1
0
Fork 0
mirror of https://github.com/zebrajr/pytorch.git synced 2025-12-07 12:21:27 +01:00
Code Issues Actions 38 Packages Projects Releases Wiki Activity
2,339 Commits 8,304 Branches 150 Tags 1.5 GiB
a1992e81b3
Commit Graph

2 Commits

Author SHA1 Message Date
Zhaoming Wu
399fc9fb09 Added Nesterov 
Summary: Added Nesterov momentum as an option for BMUF and corresponding tests

Reviewed By: asaadaldien

Differential Revision: D5599888

fbshipit-source-id: 30819c9e689347c8b75daddc7444bea9f54193ae
 2017-08-11 13:52:43 -07:00
Ahmed Taei
ffd32c8ab7 Add distributed BMUF implementation. 
Summary:
Refactor data_parallel_model all_reduce and broadcast methods to work for
a given parameter set not only gradients and reuse them for BMUF distributed
implementation.
Add a distributed test (multiprocessing) to BMUF.

Reviewed By: akyrola

Differential Revision: D5267083

fbshipit-source-id: 8dcc7527d0a755b903d693d8071585f0b54d3403
 2017-06-21 16:18:11 -07:00