Rohan Varma f5a71ec2d6 [Opt Overlap] Implement as_functional_optim and create_functional_optim (#71604) ... Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/71604 Implement 2 helper functions: - as_functional_optim which takes in a torch.optim class type and arguments and creates the corresponding functional optimizer. - create_functional_optim which takes in the functional optimizer class type and constructs it. Note that as_functional_optim calls into create_functional_optim. The first will be used in future PRs as described in https://github.com/pytorch/pytorch/issues/67570 to create a functional optimizer from a traditional optimizer. The latter is used in _OptimizerHookState to create a functional optimizer. Both new helper functions are covered by unittests. ghstack-source-id: 147577170 Test Plan: CI Reviewed By: cbalioglu Differential Revision: D33688995 fbshipit-source-id: 8b2daafd1b914efa90877cc4313aa9a428546fc1 (cherry picked from commit 42fdae2991)		2022-01-25 18:32:13 +00:00
..
_checkpoint	[FSDP/Checkpoint] Activation offload support in checkpoint_wrapper (#70165)	2021-12-21 10:08:18 -08:00
ddp_comm_hooks	[Opt Overlap] Implement as_functional_optim and create_functional_optim (#71604)	2022-01-25 18:32:13 +00:00
model_averaging	[LocalSGD] Move feature to Beta, clean up some docs (#71621)	2022-01-21 21:10:42 +00:00
quantization	[BE] minor improvement to dist quantization (#67401)	2021-11-21 23:31:59 -08:00
__init__.py	Make _Join, _Joinable, _JoinHook public (#62605)	2021-08-03 12:20:11 -07:00
join.py	Make _Join, _Joinable, _JoinHook public (#62605)	2021-08-03 12:20:11 -07:00