OSSForks/pytorch
1
0
Fork 0
mirror of https://github.com/zebrajr/pytorch.git synced 2025-12-07 12:21:27 +01:00
Code Issues Actions 38 Packages Projects Releases Wiki Activity
637ab85e7f
pytorch/test/distributed
History
Shuqiang Zhang 4aef5a1134 [c10] add an option to pg_config split share (#130877) 
Summary:
context is: #129865
We want to give users an option to not share comms resouces so that
comm opts can overlap
Test Plan:
Augmentd UT

Tags:

Pull Request resolved: https://github.com/pytorch/pytorch/pull/130877
Approved by: https://github.com/fduwjj
2024-07-19 21:11:26 +00:00
..
_composable [Compiled DDP] DDP + AC unit test (#130981) 2024-07-19 01:07:41 +00:00
_shard [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
_spmd [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
_tensor [DTensor] Fix shard_dim_alltoall fake tensor return (#129945) 2024-07-18 16:43:40 +00:00
_tools [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
algorithms [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
bin
checkpoint DSD for TorchTune LoRA (#129635) 2024-07-18 17:00:35 +00:00
elastic [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
fsdp [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
launcher Validate logs are created by default (#128522) 2024-06-17 20:07:13 +00:00
nn/jit [BE][Easy] replace import pathlib with from pathlib import Path (#129426) 2024-06-30 01:36:07 +00:00
optim [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
pipelining [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
rpc [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
tensor/parallel [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
argparse_util_test.py
test_c10d_common.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_c10d_functional_native.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_c10d_gloo.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_c10d_logger.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_c10d_nccl.py [c10] add an option to pg_config split share (#130877) 2024-07-19 21:11:26 +00:00
test_c10d_object_collectives.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_c10d_ops_nccl.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_c10d_pypg.py Enable UFMT on all of test/distributed (#123539) 2024-04-17 06:46:02 +00:00
test_c10d_spawn_gloo.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_c10d_spawn_nccl.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_c10d_spawn_ucc.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_c10d_spawn.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_c10d_ucc.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_collective_utils.py Enable UFMT on all of test/distributed (#123539) 2024-04-17 06:46:02 +00:00
test_compute_comm_reordering.py Fix and improve reorder_compute_for_overlap (#130573) 2024-07-12 22:25:49 +00:00
test_control_collectives.py [c10d] add a simple test to demonstrate the user usage of collectives (#127665) 2024-06-05 04:32:11 +00:00
test_data_parallel.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_device_mesh.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_distributed_spawn.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_dynamo_distributed.py Also put unbacked symbols in symbol_to_node in split_module pass (#130535) 2024-07-15 16:56:01 +00:00
test_fake_pg.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_functional_api.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_inductor_collectives.py Modify ExternKernelAlloc with NoneLayout to not assign its result to anything (#129188) 2024-06-22 02:57:44 +00:00
test_launcher.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_multi_threaded_pg.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_nccl.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_pg_wrapper.py [torch/distributed] Check gloo availability when doing isinstance(pg,… (#124233) 2024-04-19 04:07:00 +00:00
test_store.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00
test_symmetric_memory.py [BE][Easy][10/19] enforce style for empty lines in import segments in test/d*/ (#129761) 2024-07-17 16:57:39 +00:00