mirror of
https://github.com/zebrajr/pytorch.git
synced 2025-12-07 12:21:27 +01:00
7ba513b6e4
Optimizer state_dict config are not exposed. This PR exposes the 2 dataclass. Differential Revision: [D47766024](https://our.internmc.facebook.com/intern/diff/D47766024/) Pull Request resolved: https://github.com/pytorch/pytorch/pull/105949 Approved by: https://github.com/rohan-varma
47 lines
1.1 KiB
ReStructuredText
47 lines
1.1 KiB
ReStructuredText
FullyShardedDataParallel
|
|
========================
|
|
|
|
.. automodule:: torch.distributed.fsdp
|
|
|
|
.. autoclass:: torch.distributed.fsdp.FullyShardedDataParallel
|
|
:members:
|
|
|
|
.. autoclass:: torch.distributed.fsdp.BackwardPrefetch
|
|
:members:
|
|
|
|
.. autoclass:: torch.distributed.fsdp.ShardingStrategy
|
|
:members:
|
|
|
|
.. autoclass:: torch.distributed.fsdp.MixedPrecision
|
|
:members:
|
|
|
|
.. autoclass:: torch.distributed.fsdp.CPUOffload
|
|
:members:
|
|
|
|
.. autoclass:: torch.distributed.fsdp.StateDictConfig
|
|
:members:
|
|
|
|
.. autoclass:: torch.distributed.fsdp.FullStateDictConfig
|
|
:members:
|
|
|
|
.. autoclass:: torch.distributed.fsdp.ShardedStateDictConfig
|
|
:members:
|
|
|
|
.. autoclass:: torch.distributed.fsdp.LocalStateDictConfig
|
|
:members:
|
|
|
|
.. autoclass:: torch.distributed.fsdp.OptimStateDictConfig
|
|
:members:
|
|
|
|
.. autoclass:: torch.distributed.fsdp.FullOptimStateDictConfig
|
|
:members:
|
|
|
|
.. autoclass:: torch.distributed.fsdp.ShardedOptimStateDictConfig
|
|
:members:
|
|
|
|
.. autoclass:: torch.distributed.fsdp.LocalOptimStateDictConfig
|
|
:members:
|
|
|
|
.. autoclass:: torch.distributed.fsdp.StateDictSettings
|
|
:members:
|