Benjamin Glass 4959784dac Add API query for available per-process CUDA memory (#140620) ... Certain `cpp_wrapper`-enabled tests were OOM-ing in the CI pipeline, with error messages suggesting that sufficient memory was accessible. This ultimately resulted from an internal memory limitation that was not queryable in the API. This PR adds querying for that limit. Additionally, the failing tests had incorrect memory availability checks, and are updated with measured memory requirements. Pull Request resolved: https://github.com/pytorch/pytorch/pull/140620 Approved by: https://github.com/malfet, https://github.com/eqy ghstack dependencies: #141367		2024-12-03 00:24:03 +00:00
..
_static	[ONNX] Describe memory usage of TorchDynamo-based exporter. (#139388)	2024-11-06 17:29:11 +00:00
_templates	Add a temporary Survey about the search (#139096)	2024-10-28 23:43:25 +00:00
community	Update maintainers for inductor and x86 CPU (#136839)	2024-10-11 07:24:07 +00:00
elastic	DOC: add docstring to construct_and_record_rdzv_event() (#128189)	2024-06-10 22:17:33 +00:00
notes	Fix typo in Reproducibility docs (#141341)	2024-11-26 16:53:26 +00:00
rpc	[Doc] fix some typos (found by codespell and typos) (#132544)	2024-08-05 17:21:56 +00:00
scripts	[Doc] fix some typos (found by codespell and typos) (#132544)	2024-08-05 17:21:56 +00:00
accelerator.rst	Introduce a device-agnostic runtime API design (#132204)	2024-10-27 10:37:09 +00:00
amp.rst	Update document for autocast on CPU (#135299)	2024-09-13 09:11:47 +00:00
autograd.rst	Add torch.library.register_autograd (#124071)	2024-04-18 12:47:59 +00:00
backends.rst	Clarify opt-einsum usage, fix #127109 (#137596)	2024-10-09 20:31:24 +00:00
benchmark_utils.rst	Adding Compare in torch.utils.benchmark documentation (#125009)	2024-05-03 00:50:54 +00:00
bottleneck.rst
checkpoint.rst	[checkpoint] Clean up selective activation checkpoint and make public (#125795)	2024-06-18 18:18:50 +00:00
complex_numbers.rst	Document complex optimizer semantic behavior (#121667)	2024-03-16 00:43:47 +00:00
cond.rst	[Doc] fix some typos (found by codespell and typos) (#132544)	2024-08-05 17:21:56 +00:00
conf.py	Add API query for available per-process CUDA memory (#140620)	2024-12-03 00:24:03 +00:00
config_mod.rst
cpp_extension.rst
cpp_index.rst
cpu.rst	Add current_device() to torch.cpu (#110987)	2023-10-11 05:13:10 +00:00
cuda_environment_variables.rst	Add doc page for environment variables that effect PyTorch Runtime (#119087)	2024-02-15 21:41:38 +00:00
cuda._sanitizer.rst
cuda.rst	Add API query for available per-process CUDA memory (#140620)	2024-12-03 00:24:03 +00:00
cuda.tunable.rst	[ROCM] Support Multi-GPU offline tuning in TunableOp (#139673)	2024-11-26 19:07:41 +00:00
cudnn_persistent_rnn.rst
cudnn_rnn_determinism.rst
data.rst
ddp_comm_hooks.rst
debugging_environment_variables.rst	Add doc page for environment variables that effect PyTorch Runtime (#119087)	2024-02-15 21:41:38 +00:00
deploy.rst
deterministic.rst	Add torch.utils.deterministic.fill_uninitialized_memory flag (#111377)	2023-11-01 16:10:09 +00:00
distributed.algorithms.join.rst
distributed.checkpoint.rst	[DCP] Cross-link DCP doc to tutorials (#139776)	2024-11-07 02:19:49 +00:00
distributed.elastic.rst	Reapply "distributed debug handlers (#126601)" (#127805)	2024-06-04 19:44:30 +00:00
distributed.optim.rst
distributed.pipelining.rst	[Pipelining] Refactor Interleaved1F1B and ZeroBubble (#137783)	2024-10-16 03:05:14 +00:00
distributed.rst	[distributed] add PG APIs and general doc cleanups (#140853)	2024-11-19 02:06:32 +00:00
distributed.tensor.parallel.rst	Update link in distributed.tensor.parallel.rst (#136103)	2024-09-15 19:36:29 +00:00
distributed.tensor.rst	[dtensor][experimental] expose DTensor Context Parallel API (#137038)	2024-10-02 18:00:23 +00:00
distributions.rst	Add inverse gamma distribution and fix sign bug in PowerTransform. (#104501)	2023-11-01 02:26:25 +00:00
dlpack.rst
docutils.conf
export.ir_spec.rst	[doc] Fix grammar in export.ir_spec.rst (#139584)	2024-11-05 23:26:36 +00:00
export.rst	Revert "Add truediv support in export serializer (#136364)"	2024-11-27 03:24:31 +00:00
fft.rst
fsdp.rst
func.api.rst
func.batch_norm.rst
func.migrating.rst
func.rst
func.ux_limitations.rst
func.whirlwind_tour.rst
future_mod.rst	Add swap_tensors path to nn.Module._apply (#117167)	2024-02-07 18:55:44 +00:00
futures.rst
fx.experimental.rst	Use has_free_unbacked_symbols instead of bool(free_unbacked_symbols) (#140027)	2024-11-15 19:01:06 +00:00
fx.rst	Consolidate SymDispatchMode into ProxyTensorMode (#132674)	2024-08-08 12:02:54 +00:00
hub.rst
index.rst	Introduce a device-agnostic runtime API design (#132204)	2024-10-27 10:37:09 +00:00
jit_builtin_functions.rst
jit_language_reference_v2.rst	[Doc] fix some typos (found by codespell and typos) (#132544)	2024-08-05 17:21:56 +00:00
jit_language_reference.rst	[Doc] fix some typos (found by codespell and typos) (#132544)	2024-08-05 17:21:56 +00:00
jit_python_reference.rst
jit_unsupported.rst	Add support for torch.Generator type in TorchScript (#110413)	2023-11-21 23:07:21 +00:00
jit_utils.rst
jit.rst	Doc test non packages (#110568)	2023-10-06 14:16:01 +00:00
library.rst	[doc] fixing missing colon in custom op doc (#140060)	2024-11-07 23:48:44 +00:00
linalg.rst
logging.rst	Change classification to beta for TORCH_LOGS (#118682)	2024-01-31 21:50:55 +00:00
masked.rst	Add MaskedTensor passthrough: unfold, F.Unfold, F.Fold, stack (#125262)	2024-09-06 19:06:23 +00:00
math-quantizer-equation.png
meta.rst	Add documentation for meta device (#119119)	2024-02-04 01:05:22 +00:00
miscellaneous_environment_variables.rst	Add environment variable to force no weights_only load (#138225)	2024-10-21 23:26:15 +00:00
mobile_optimizer.rst	Add ExecuTorch warning to mobile_optimizer (#134697)	2024-09-04 17:47:14 +00:00
model_zoo.rst
module_tracker.rst	Add module tracker (#125352)	2024-05-04 18:33:35 +00:00
monitor.rst
mps_environment_variables.rst	[MPS] Add mps profiler env vars to docs (#129552)	2024-07-04 06:44:48 +00:00
mps.rst	Add support in Python API for the recommended max working set size. (#128289)	2024-06-12 16:03:57 +00:00
mtia.rst	[MTIA] Support torch.mtia.empty_cache() (#141533)	2024-11-28 02:24:19 +00:00
multiprocessing.rst	Doc test non packages (#110568)	2023-10-06 14:16:01 +00:00
name_inference.rst	[docs] Properly link register_post_accumulate_grad_hook docs (#108157)	2023-08-29 22:13:33 +00:00
named_tensor.rst
nested.rst
nn.attention.bias.rst	Remove sdp_kernel and replace with sdpa_kernel in attention namespace (#114689)	2024-01-24 22:28:04 +00:00
nn.attention.experimental.rst	[Flex Attention] Paged Attention (#137164)	2024-10-29 17:05:22 +00:00
nn.attention.flex_attention.rst	FlexAttention support for NJT (#136792)	2024-10-28 20:01:27 +00:00
nn.attention.rst	[Flex Attention] Paged Attention (#137164)	2024-10-29 17:05:22 +00:00
nn.functional.rst	Add RMSNorm module (#121364)	2024-03-29 18:05:28 +00:00
nn.init.rst
nn.rst	Add APIs to separate norm calculation and gradient scaling in nn.utils.clip_grad_norm_ (#139662)	2024-11-07 23:13:23 +00:00
onnx_dynamo_memory_usage.rst	[ONNX] Describe memory usage of TorchDynamo-based exporter. (#139388)	2024-11-06 17:29:11 +00:00
onnx_dynamo_onnxruntime_backend.rst	Follow-up #108379 (#108905)	2023-09-09 01:38:36 +00:00
onnx_dynamo.rst	[ONNX] Describe memory usage of TorchDynamo-based exporter. (#139388)	2024-11-06 17:29:11 +00:00
onnx_torchscript_supported_aten_ops.rst	Refactor torch.onnx documentation (#108379)	2023-09-08 18:23:48 +00:00
onnx_torchscript.rst	[ONNX] Remove deprecated export_to_pretty_string (#137790)	2024-10-21 18:17:48 +00:00
onnx.rst	[ONNX] Improves documentation of ONNX exporter (#135372)	2024-09-09 15:09:01 +00:00
optim.rst	Ensure SWA boundary conditions w.r.t. definition (#133773)	2024-10-31 18:24:08 +00:00
package.rst	Doc test non packages (#110568)	2023-10-06 14:16:01 +00:00
profiler.rst	Doc test non packages (#110568)	2023-10-06 14:16:01 +00:00
quantization-accuracy-debugging.rst
quantization-backend-configuration.rst
quantization-support.rst	Update pt2e numeric debugger to use node.meta["custom"] field (#134040)	2024-08-27 19:51:03 +00:00
quantization.rst	[Intel GPU] XPUInductorQuantizer for XPU int8 recipe customization (#139578)	2024-11-26 09:44:14 +00:00
random.rst
rpc.rst
signal.rst
size.rst	Added a docstring for torch.Size.numel. (#124186)	2024-04-19 09:23:02 +00:00
sparse.rst	SparseCsrCUDA: cuDSS backend for linalg.solve (#129856)	2024-08-22 07:57:30 +00:00
special.rst
storage.rst	Doc: Rewrite the storage.rst file to emphasize untyped storages (#140145)	2024-11-13 17:40:16 +00:00
tensor_attributes.rst	[Docs] Remove duplicate declaration of double_tensor (#140927)	2024-11-18 21:22:30 +00:00
tensor_view.rst
tensorboard.rst
tensors.rst	add xpu to torch.tensors (#127280)	2024-06-11 18:13:01 +00:00
testing.rst
threading_environment_variables.rst	Add doc page for environment variables that effect PyTorch Runtime (#119087)	2024-02-15 21:41:38 +00:00
torch_cuda_memory.rst	Fix typo under docs directory (#110359)	2023-10-03 16:36:05 +00:00
torch_environment_variables.rst	[Docs][MPS] Add mps environment variable table (#129008)	2024-06-20 03:30:35 +00:00
torch_nccl_environment_variables.rst	[c10d][doc] Add docs for ENV variables TORCH_NCCL_ASYNC_ERROR_HANDLING TORCH_NCCL_TRACE_CPP_STACK and TORCH_NCCL_COORD_CHECK_MILSEC (#132920)	2024-08-09 21:08:20 +00:00
torch.ao.ns._numeric_suite_fx.rst
torch.ao.ns._numeric_suite.rst
torch.compiler_aot_inductor_minifier.rst	[aoti] Remove example inputs from aoti_compile_and_package (#140991)	2024-11-20 02:49:47 +00:00
torch.compiler_aot_inductor.rst	[aoti] Remove example inputs from aoti_compile_and_package (#140991)	2024-11-20 02:49:47 +00:00
torch.compiler_api.rst	[dynamo] add torch.compiler.set_stance (#137504)	2024-10-16 16:18:25 +00:00
torch.compiler_best_practices_for_backends.rst
torch.compiler_cudagraph_trees.rst	[CUDAGraph] add more docs for cudagraph trees (#127963)	2024-06-18 02:07:07 +00:00
torch.compiler_custom_backends.rst	[pt2, docs] Add new PT2 troubleshooting doc (#138620)	2024-11-09 01:17:39 +00:00
torch.compiler_dynamic_shapes.rst	feat: Add min, max ranges to mark_dynamic API (#119737)	2024-03-07 23:26:03 +00:00
torch.compiler_dynamo_deepdive.rst	fix typo in torch.compiler_dynamo_deepdive.rst (#140871)	2024-11-19 14:42:36 +00:00
torch.compiler_dynamo_overview.rst	Rename TorchDynamo -> Dyanamo in the dynamo tutorial doc (#123431)	2024-05-07 05:07:00 +00:00
torch.compiler_fake_tensor.rst	[doc] improve code in fake tensor doc (#140329)	2024-11-13 05:14:56 +00:00
torch.compiler_faq.rst	[pt2, docs] Add new PT2 troubleshooting doc (#138620)	2024-11-09 01:17:39 +00:00
torch.compiler_fine_grain_apis.rst	[Doc] fix some typos (found by codespell and typos) (#132544)	2024-08-05 17:21:56 +00:00
torch.compiler_get_started.rst	[Inductor] Update AttrsDescriptor instantiation for Triton changes (#137458)	2024-10-14 20:20:29 +00:00
torch.compiler_inductor_profiling.rst
torch.compiler_ir.rst	[export] torch.export landing page (#108783)	2023-09-10 01:40:42 +00:00
torch.compiler_nn_module.rst	Revert "Reland 3rd try [finishing colesbury's PR 100642] Guard on nn.Module dicts and type (#109323)" + Forward fixes + test (#110964)	2023-10-11 05:16:47 +00:00
torch.compiler_performance_dashboard.rst
torch.compiler_profiling_torch_compile.rst	[EZ] Fix spelling typo (#136157)	2024-09-16 19:30:30 +00:00
torch.compiler_transformations.rst	Fix typo under docs directory (#110359)	2023-10-03 16:36:05 +00:00
torch.compiler_troubleshooting_old.rst	[pt2, docs] Add new PT2 troubleshooting doc (#138620)	2024-11-09 01:17:39 +00:00
torch.compiler_troubleshooting.rst	[pt2, docs] Add new PT2 troubleshooting doc (#138620)	2024-11-09 01:17:39 +00:00
torch.compiler.config.rst	Profile guided optimization for automatic_dynamic (#139001)	2024-11-03 06:29:57 +00:00
torch.compiler.rst	Profile guided optimization for automatic_dynamic (#139001)	2024-11-03 06:29:57 +00:00
torch.overrides.rst	Doc test non packages (#110568)	2023-10-06 14:16:01 +00:00
torch.rst	Add docs page for torch.inf and torch.nan (#138430)	2024-10-31 05:46:46 +00:00
type_info.rst
utils.rst	New swap function (#111747)	2023-12-08 18:49:35 +00:00
xpu.rst	Add torch.xpu.get_arch_list and torch.xpu.get_gencode_flags for XPU (#137773)	2024-10-18 02:28:08 +00:00