OSSForks/pytorch
1
0
Fork 0
mirror of https://github.com/zebrajr/pytorch.git synced 2025-12-07 12:21:27 +01:00
Code Issues Actions 37 Packages Projects Releases Wiki Activity
637ab85e7f
pytorch/test/distributed/checkpoint
History
mori360 5979014059 DSD for TorchTune LoRA (#129635) 
Fixes #128745
Solve the issue with conflicts when users use full_state_dict while the model is FSDP.

Current solve the issue for `full_state_dict=True`, with error
`'aten.copy_.default: got mixed torch.Tensor and DTensor, need to convert all torch.Tensor to DTensor before calling distributed operators!',).`

TODO: for` broadcast_from_rank0=True, full_state_dict=True`, the error is
`NotImplementedError: c10d::broadcast_: attempted to run this operator with Meta tensors`

Pull Request resolved: https://github.com/pytorch/pytorch/pull/129635
Approved by: https://github.com/fegin
2024-07-18 17:00:35 +00:00
..
e2e [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
fsdp [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_checkpoint.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_compatibility.py [DCP] Adds storage metadata, and passes it during the save path (#124772) 2024-05-07 23:53:53 +00:00
test_dedup_tensors.py [DCP][BE] Apply ufmt to DCP and turn on lintrunner for DCP (#115302) 2023-12-13 10:32:36 +00:00
test_dtensor_checkpoint.py [DCP][BE] Apply ufmt to DCP and turn on lintrunner for DCP (#115302) 2023-12-13 10:32:36 +00:00
test_dtensor_resharding.py [DTensor] Remove assert to allow tensor sharding dimension < Shard(x).ndim (#115114) 2023-12-07 21:57:30 +00:00
test_file_system_checkpoint_cpu.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_file_system_checkpoint.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_format_utils.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_fsdp_model_state.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_fsdp_optim_state.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_fsdp_tp_checkpoint_conversion.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_fsspec.py [BE][EZ] Migrate to new dcp save and load APIs (#130475) 2024-07-11 04:13:39 +00:00
test_hsdp_checkpoint.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_nested_dict.py [DCP] Always flatten mapping even if no tensors present (#125335) 2024-05-07 17:08:49 +00:00
test_planner.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_save_load_api.py [DCP] Fix broken validate checkpoint api test (#124786) 2024-04-25 14:50:58 +00:00
test_state_dict_utils.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_state_dict.py DSD for TorchTune LoRA (#129635) 2024-07-18 17:00:35 +00:00
test_tp_checkpoint.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_traverse.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_utils.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00