lzhang2 1886e33f60 Use device-agnostic runtime API in distributed DDP/FSDP instead of cuda device specific. (#137678) ... # Motivation This PR targets to use device-agnostic runtime API in distributed DDP/FSDP instead of `cuda` device specific. cc cc [@jgong5](https://github.com/jgong5) [@gujinghui](https://github.com/gujinghui) [@EikanWang](https://github.com/EikanWang) [@fengyuan14](https://github.com/fengyuan14) [@guangyey](https://github.com/guangyey) Pull Request resolved: https://github.com/pytorch/pytorch/pull/137678 Approved by: https://github.com/kwen2501, https://github.com/guangyey, https://github.com/jgong5		2024-11-13 05:32:19 +00:00
..
__init__.py
averagers.py
hierarchical_model_averager.py
utils.py	Use device-agnostic runtime API in distributed DDP/FSDP instead of cuda device specific. (#137678)	2024-11-13 05:32:19 +00:00