Matthew Hoffman 68b0db1274 Define the public API for torch.distributed.fsdp (#109922) ... Related: https://github.com/pytorch/pytorch/wiki/Public-API-definition-and-documentation Related: https://github.com/microsoft/pylance-release/issues/2953 This fixes pylance issues for these classes: ``` "FullyShardedDataParallel" is not exported from module "torch.distributed.fsdp" ``` These classes all have public docs: * [`BackwardPrefetch`](https://pytorch.org/docs/stable/fsdp.html#torch.distributed.fsdp.BackwardPrefetch) * [`CPUOffload`](https://pytorch.org/docs/stable/fsdp.html#torch.distributed.fsdp.CPUOffload) * [`FullyShardedDataParallel`](https://pytorch.org/docs/stable/fsdp.html#torch.distributed.fsdp.FullyShardedDataParallel) * [`MixedPrecision`](https://pytorch.org/docs/stable/fsdp.html#torch.distributed.fsdp.MixedPrecision) * [`ShardingStrategy`](https://pytorch.org/docs/stable/fsdp.html#torch.distributed.fsdp.ShardingStrategy) And it seems like all the newly added classes will have docs once they are released. Pull Request resolved: https://github.com/pytorch/pytorch/pull/109922 Approved by: https://github.com/wanchaol		2023-09-28 02:15:58 +00:00
..
fully_shard	Define the public API for torch.distributed.fsdp (#109922)	2023-09-28 02:15:58 +00:00
test_checkpoint.py	[Composable] Use non-reentrant generator, remove reentrant (#105176)	2023-07-26 07:03:03 +00:00
test_compose.py	composable fsdp, checkpoint, + compile test (#105180)	2023-07-26 07:03:09 +00:00
test_contract.py	[Composable] add checking key for check_fqn function (#98961)	2023-04-13 03:16:14 +00:00
test_replicate.py	[composable API] Fix the replicate_device_id test case to avoid copy replicated models. (#105503)	2023-07-19 16:20:43 +00:00