Edward Z. Yang 1f3fa13f0a Handle unbacked SymInt sized outputs in AOTAutograd (#113159) ... Thanks aakhundov for constructing the test case. This PR was constructed by running the failing test case, and then fixing problems until we got all the way to the end. There are a few distinct fixes: * AOTAutograd performs equality tests on tensor metadata to determine if a metadata mutation had occurred. If we test i0 vs i1, we should report these are NOT equal, since obviously we have somehow resized the tensor from i0 to i1 (even if, on a particular run, it is possible i0 == i1). * There's a sketchy fix for `test_aot_autograd_exhaustive_matmul_cpu_float32` where we check if the output shape equals the tangent shape. Unfortunately, the same `definitely_true` treatment does not work here, it still fails on the example. I piled an extra sketchy fix on top of it, where I just try my best to avoid doing the view. Maybe we should have some sort of logging here. * Partitioner needs to get out a size for unbacked SymInt when partitioning. I just feed it a random heuristic value in this case, similar to how we've been dealing with this in Inductor. Signed-off-by: Edward Z. Yang <ezyang@meta.com> Pull Request resolved: https://github.com/pytorch/pytorch/pull/113159 Approved by: https://github.com/aakhundov, https://github.com/bdhirsh		2023-11-08 04:28:38 +00:00
..
_static	Refactor torch.onnx documentation (#108379)	2023-09-08 18:23:48 +00:00
_templates	Replace master with main in links and docs/conf.py (#100176)	2023-05-02 18:20:32 +00:00
community	updated aarch64 maintainers in docs (#112047)	2023-10-27 21:09:36 +00:00
elastic
notes	Add a note about performant record_stream use. (#112526)	2023-11-02 15:50:22 +00:00
rpc
scripts	[export oncall] add some examples during oncall (#112445)	2023-10-31 18:33:03 +00:00
amp.rst	Add torch.utils.deterministic.fill_uninitialized_memory flag (#111377)	2023-11-01 16:10:09 +00:00
autograd.rst	Allow specifiying inputs as GradientEdge in autograd APIs (#110867)	2023-10-12 04:08:44 +00:00
backends.rst	Doc test non packages (#110568)	2023-10-06 14:16:01 +00:00
benchmark_utils.rst
bottleneck.rst
checkpoint.rst	Add set_checkpoint_debug_enabled that overrides local setting (#110728)	2023-10-11 02:12:31 +00:00
complex_numbers.rst	Remove CUDA 11.6 note from complex docs (#100118)	2023-04-27 16:26:27 +00:00
cond.rst	[HigherOrderOp] expose torch.cond (#110293)	2023-10-07 20:39:52 +00:00
conf.py	Handle unbacked SymInt sized outputs in AOTAutograd (#113159)	2023-11-08 04:28:38 +00:00
config_mod.rst
cpp_extension.rst
cpp_index.rst
cpu.rst	Add current_device() to torch.cpu (#110987)	2023-10-11 05:13:10 +00:00
cuda._sanitizer.rst
cuda.rst	Doc test non packages (#110568)	2023-10-06 14:16:01 +00:00
cudnn_persistent_rnn.rst
cudnn_rnn_determinism.rst
data.rst	Revert "reseed all Generators in Dataloader's _worker_loop() -- via GC (#107131)"	2023-08-23 17:08:07 +00:00
ddp_comm_hooks.rst	[DOCS][DDP]Fix the simple of saving and reloading PowerSGD state and hook. (#102721)	2023-06-10 00:15:00 +00:00
deploy.rst
deterministic.rst	Add torch.utils.deterministic.fill_uninitialized_memory flag (#111377)	2023-11-01 16:10:09 +00:00
distributed.algorithms.join.rst
distributed.checkpoint.rst	[state_dict][9/N] Add get and set APIs for model and optimizer state_dict (#112203)	2023-11-02 22:03:57 +00:00
distributed.elastic.rst
distributed.optim.rst
distributed.rst	Doc test non packages (#110568)	2023-10-06 14:16:01 +00:00
distributed.tensor.parallel.rst	[TP] Add deprecation warnings in the documentations for Pairwise parallel, sequence parallel and other prepare input/output functions (#111176)	2023-10-15 00:39:24 +00:00
distributions.rst	Add inverse gamma distribution and fix sign bug in PowerTransform. (#104501)	2023-11-01 02:26:25 +00:00
dlpack.rst
docutils.conf
export.ir_spec.rst	Revert "direct runtime assertions (#111262)"	2023-10-17 08:04:36 +00:00
export.rst	[export] Clean up verifier [1/n]. (#112505)	2023-11-02 19:36:06 +00:00
fft.rst
fsdp.rst	[FSDP][state_dict] Expose optimizer state_dict config (#105949)	2023-08-21 07:29:49 +00:00
func.api.rst
func.batch_norm.rst	Fix typo under docs directory (#97202)	2023-03-21 01:24:10 +00:00
func.migrating.rst
func.rst
func.ux_limitations.rst
func.whirlwind_tour.rst
futures.rst
fx.rst	Split SymNode into its own file (#112037)	2023-10-26 23:32:27 +00:00
hub.rst
index.rst	Add torch.utils.deterministic.fill_uninitialized_memory flag (#111377)	2023-11-01 16:10:09 +00:00
jit_builtin_functions.rst
jit_language_reference_v2.rst	Fix typo under docs directory (#97202)	2023-03-21 01:24:10 +00:00
jit_language_reference.rst
jit_python_reference.rst
jit_unsupported.rst	Revert "Add support for torch.Generator type in TorchScript (#110413)"	2023-11-07 15:53:32 +00:00
jit_utils.rst
jit.rst	Doc test non packages (#110568)	2023-10-06 14:16:01 +00:00
library.rst	Rewrite torch.library's documentation (#111310)	2023-10-23 23:02:41 +00:00
linalg.rst
logging.rst	[Easy] log graphs in compiled_autograd if TORCH_LOGS=compiled_autograd (#108991)	2023-09-12 00:15:02 +00:00
masked.rst	Doc test non packages (#110568)	2023-10-06 14:16:01 +00:00
math-quantizer-equation.png
mobile_optimizer.rst
model_zoo.rst
monitor.rst
mps.rst	Doc test non packages (#110568)	2023-10-06 14:16:01 +00:00
multiprocessing.rst	Doc test non packages (#110568)	2023-10-06 14:16:01 +00:00
name_inference.rst	[docs] Properly link register_post_accumulate_grad_hook docs (#108157)	2023-08-29 22:13:33 +00:00
named_tensor.rst	fixing named tensor unflatten example (#106921)	2023-08-22 18:00:10 +00:00
nested.rst	Replace master with main in links and docs/conf.py (#100176)	2023-05-02 18:20:32 +00:00
nn.functional.rst
nn.init.rst
nn.rst	define public API for torch.nn.utils (#111026)	2023-10-12 23:05:23 +00:00
onnx_dynamo_onnxruntime_backend.rst	Follow-up #108379 (#108905)	2023-09-09 01:38:36 +00:00
onnx_dynamo.rst	Rename torch.onnx.ExportOutput* to ONNXProgram* (#112263)	2023-11-06 22:27:15 +00:00
onnx_torchscript_supported_aten_ops.rst	Refactor torch.onnx documentation (#108379)	2023-09-08 18:23:48 +00:00
onnx_torchscript.rst	Follow-up #108379 (#108905)	2023-09-09 01:38:36 +00:00
onnx.rst	Doc test non packages (#110568)	2023-10-06 14:16:01 +00:00
optim.rst	Doc test non packages (#110568)	2023-10-06 14:16:01 +00:00
package.rst	Doc test non packages (#110568)	2023-10-06 14:16:01 +00:00
pipeline.rst	docs: Linking ResNeXt PyTorch Hub Pipeline (#98689)	2023-04-11 02:20:26 +00:00
profiler.rst	Doc test non packages (#110568)	2023-10-06 14:16:01 +00:00
quantization-accuracy-debugging.rst
quantization-backend-configuration.rst
quantization-support.rst	Doc test non packages (#110568)	2023-10-06 14:16:01 +00:00
quantization.rst	[quant][docs] Add x86 inductor quant docs (#112648)	2023-11-02 17:02:09 +00:00
random.rst
rpc.rst	[BE] RPC is missing RRef docs (#106902)	2023-08-10 16:26:27 +00:00
signal.rst
sparse.rst	Fix typo under docs directory (#110359)	2023-10-03 16:36:05 +00:00
special.rst
storage.rst
tensor_attributes.rst
tensor_view.rst
tensorboard.rst
tensors.rst	[docs] Properly link register_post_accumulate_grad_hook docs (#108157)	2023-08-29 22:13:33 +00:00
testing.rst
torch_cuda_memory.rst	Fix typo under docs directory (#110359)	2023-10-03 16:36:05 +00:00
torch.ao.ns._numeric_suite_fx.rst
torch.ao.ns._numeric_suite.rst
torch.compiler_api.rst	Add cudagraph_mark_step_begin in torch.compiler, reference in error message (#111722)	2023-10-25 21:53:21 +00:00
torch.compiler_best_practices_for_backends.rst	Restructure torch.compile docs (#105376)	2023-07-28 20:58:57 +00:00
torch.compiler_cudagraph_trees.rst	Add cudagraph_mark_step_begin in torch.compiler, reference in error message (#111722)	2023-10-25 21:53:21 +00:00
torch.compiler_custom_backends.rst	Restructure torch.compile docs (#105376)	2023-07-28 20:58:57 +00:00
torch.compiler_deepdive.rst	[Dynamo]Expose bytecode hooks and add example usage for decompilation in docs (#110714)	2023-10-13 12:36:00 +00:00
torch.compiler_dynamic_shapes.rst	Update dynamic shapes documentation (#109764)	2023-09-21 13:53:43 +00:00
torch.compiler_fake_tensor.rst	Restructure torch.compile docs (#105376)	2023-07-28 20:58:57 +00:00
torch.compiler_faq.rst	Add docs for torch.compile(numpy) (#109710)	2023-09-21 03:05:21 +00:00
torch.compiler_fine_grain_apis.rst	Restructure torch.compile docs (#105376)	2023-07-28 20:58:57 +00:00
torch.compiler_get_started.rst	[Reland2] [inductor][BE] split triton_meta and inductor_meta (#112351)	2023-11-02 00:40:12 +00:00
torch.compiler_guards_overview.rst	Do not use a specific LOC in link (#108957)	2023-09-13 19:21:45 +00:00
torch.compiler_inductor_profiling.rst	Restructure torch.compile docs (#105376)	2023-07-28 20:58:57 +00:00
torch.compiler_ir.rst	[export] torch.export landing page (#108783)	2023-09-10 01:40:42 +00:00
torch.compiler_nn_module.rst	Revert "Reland 3rd try [finishing colesbury's PR 100642] Guard on nn.Module dicts and type (#109323)" + Forward fixes + test (#110964)	2023-10-11 05:16:47 +00:00
torch.compiler_performance_dashboard.rst	Restructure torch.compile docs (#105376)	2023-07-28 20:58:57 +00:00
torch.compiler_profiling_torch_compile.rst	Restructure torch.compile docs (#105376)	2023-07-28 20:58:57 +00:00
torch.compiler_transformations.rst	Fix typo under docs directory (#110359)	2023-10-03 16:36:05 +00:00
torch.compiler_troubleshooting.rst	Fix rst formatting in torch.compiler_troubleshooting.rst (#107360)	2023-08-18 01:04:24 +00:00
torch.compiler.rst	Add openvino backend into torch.compile docs (#112321)	2023-10-30 20:13:41 +00:00
torch.overrides.rst	Doc test non packages (#110568)	2023-10-06 14:16:01 +00:00
torch.rst	Document torch.from_file and fix UntypedStorage.from_file docs (#111688)	2023-10-25 19:28:11 +00:00
type_info.rst
utils.rst	Doc test non packages (#110568)	2023-10-06 14:16:01 +00:00