pytorch/test/distributed/pipelining
Anant Gulati 937b41e3b5 Refactoring pipeline parallelism test cases to be device agnostic [1/n] (#146472)
In this series of PR we intend to refactor pipeline parallelism test cases to enable to be completely device agnostic.

These changes will include the following approaches to do the same :

- Allowing for multiple device types using instantiate_device_type_test
- Replacing calls to cuda stream with torch.get_device_module(device) wherever it applies

This should result in improvement in usability for all devices

For this PR we have shown support for the following devices:

- CPU (wherever applicable)
- CUDA
- HPU
- XPU

To add other device new users can simply append their device to the device list

Pull Request resolved: https://github.com/pytorch/pytorch/pull/146472
Approved by: https://github.com/H-Huang
2025-02-11 00:13:23 +00:00
..
artifacts [Pipelining] Support separate dI / dW and V-schedules (#131762) 2024-10-31 22:49:45 +00:00
__init__.py [pipelining] Consolidate test models into a registry (#126114) 2024-05-14 19:11:54 +00:00
model_registry.py Fix unused Python variables in test/[a-d]* (#134665) 2024-12-13 22:13:12 +00:00
schedule_registry.py Remove stage_index_to_group_rank from schedule (#146217) 2025-02-05 21:26:45 +00:00
test_backward.py Refactoring pipeline parallelism test cases to be device agnostic [1/n] (#146472) 2025-02-11 00:13:23 +00:00
test_microbatch.py Refactoring pipeline parallelism test cases to be device agnostic [1/n] (#146472) 2025-02-11 00:13:23 +00:00
test_pipe.py Add None return type to init -- tests rest (#132376) 2024-08-01 15:44:51 +00:00
test_schedule_multiproc.py Remove stage_index_to_group_rank from schedule (#146217) 2025-02-05 21:26:45 +00:00
test_schedule.py Remove stage_index_to_group_rank from schedule (#146217) 2025-02-05 21:26:45 +00:00
test_stage.py Fix unused Python variables in test/[a-d]* (#134665) 2024-12-13 22:13:12 +00:00
test_transformer.py Refactoring pipeline parallelism test cases to be device agnostic [1/n] (#146472) 2025-02-11 00:13:23 +00:00
test_unflatten.py Refactoring pipeline parallelism test cases to be device agnostic [1/n] (#146472) 2025-02-11 00:13:23 +00:00