pytorch/test/cpp
fduwjj 5b4c864672 [c10d] Enable CudaEventCache by default and add multi device support (#140975)
We added `CudaEventCache` in https://github.com/pytorch/pytorch/pull/133727 and this is a feature which tries to reuse CudaEvent so that we don't call destroy of CudaEvent which causes hang in the past. We had a bunch of tests and testing on TorchTitan and internal workload already. So far no errors or crash are found at the moment so we decide to roll out to all OSS users. For internal workload, this PR would not affect it because of some internal gating.

Also we observed some multi-device use cases in OSS, so that we want to bring back multi-device support originally proposed in https://github.com/pytorch/pytorch/pull/122732/files.

Pull Request resolved: https://github.com/pytorch/pytorch/pull/140975
Approved by: https://github.com/eqy, https://github.com/kwen2501
2024-11-26 18:42:45 +00:00
..
aoti_abi_check [AOTI] Fix complex64 not defined (#132810) 2024-08-08 18:08:23 +00:00
aoti_inference [AOTI] Update C++ runner API to take a const vector (#139955) 2024-11-08 16:59:10 +00:00
api torch::optional -> std::optional (#138987) 2024-10-28 19:09:46 +00:00
c10d [c10d] Enable CudaEventCache by default and add multi device support (#140975) 2024-11-26 18:42:45 +00:00
common [AOTI] Add ABI-compatiblity tests (#123848) 2024-04-19 00:51:24 +00:00
dist_autograd Set RUNPATH so installed tests can find the required shared libraries (#136627) 2024-10-25 09:38:08 +00:00
jit Revert "[2/N] Replace c10::sv with std::sv (#139456)" 2024-11-07 17:00:59 +00:00
lazy [8/N] Don't skip ASAN on some tests (#140081) 2024-11-09 01:00:13 +00:00
lite_interpreter_runtime Add None return type to init -- tests (#132352) 2024-08-01 15:44:51 +00:00
monitor
profiler [Record Function] Add Kwargs only USER_SCOPE Macro (#138020) 2024-10-17 18:48:49 +00:00
rpc Set RUNPATH so installed tests can find the required shared libraries (#136627) 2024-10-25 09:38:08 +00:00
tensorexpr Set RUNPATH so installed tests can find the required shared libraries (#136627) 2024-10-25 09:38:08 +00:00
__init__.py