pytorch/test/distributed/checkpoint
Chien-Chin Huang 88616349d7 [state_dict][1/N] Implement the basic functions of distributed.checkpoint._state_dict (#105902)
This PR implements the basic functions of distributed.checkpoint._state_dict. This PR currently contains the flattening of optimizer state_dict which makes the PR too large. A later version may split it into 2 for a better code review.

Differential Revision: [D47647719](https://our.internmc.facebook.com/intern/diff/D47647719/)

**NOTE FOR REVIEWERS**: This PR has internal Meta-specific changes or comments, please review them on [Phabricator](https://our.internmc.facebook.com/intern/diff/D47647719/)!
Pull Request resolved: https://github.com/pytorch/pytorch/pull/105902
Approved by: https://github.com/wz337
2023-10-05 20:04:15 +00:00
..
test_checkpoint.py [BE] [3/3] Rewrite super() calls in test (#94592) 2023-02-12 22:20:53 +00:00
test_dedup_tensors.py
test_dtensor_checkpoint.py [PTD][Checkpoint] Add checkpointing support for DTensor submesh (#96802) 2023-03-21 08:17:17 +00:00
test_dtensor_resharding.py [DCP][test] Update test_dtensor_resharding.py (#109619) 2023-09-20 19:05:07 +00:00
test_file_system_checkpoint_cpu.py [DCP][Test] Fix device assignment in test/distributed/checkpoint/test_file_system_checkpoint_cpu.py (#109141) 2023-09-13 03:04:14 +00:00
test_file_system_checkpoint.py [BE] [3/3] Rewrite super() calls in test (#94592) 2023-02-12 22:20:53 +00:00
test_fsdp_model_state.py [DTensorTestbase] Add "cpu:gloo,cuda:nccl" backend to DTensorTestbase (#110397) 2023-10-03 04:54:02 +00:00
test_fsdp_optim_state.py [DTensorTestbase] Add "cpu:gloo,cuda:nccl" backend to DTensorTestbase (#110397) 2023-10-03 04:54:02 +00:00
test_fsdp_tp_checkpoint_conversion.py [DCP] Add unit test for FSDP -> TP checkpoint conversion (#109899) 2023-09-23 09:19:45 +00:00
test_fsspec.py [DCP][fsspec] Consolidate OSS FsspecWriter/Reader and internal FsspecWriter/Reader (#104724) 2023-07-10 19:31:01 +00:00
test_nested_dict.py
test_planner.py [DCP] Modify tensor saving logic in DCP (#106415) 2023-08-09 00:16:10 +00:00
test_state_dict.py [state_dict][1/N] Implement the basic functions of distributed.checkpoint._state_dict (#105902) 2023-10-05 20:04:15 +00:00
test_tp_checkpoint.py [DCP]Add unit test for tp checkpoint (#108286) 2023-09-01 00:30:13 +00:00
test_traverse.py
test_utils.py