Will Constable 6eab5e88c8 Graph-break on allowed modules if they have hooks (#97184) ... Allowed modules are stuck into dynamo's fx graph as call_module nodes, without dynamo doing any tracing of the module. This means during AOT trace time, hooks will fire during tracing when the call_module is executed, but the hooks themselves will disappear after that and not be present in the compiled program. (worse, if they performed any tensor operations, those would get traced so you could end up with part of the hook's functionality). To circumvent this, there are two options for 'allowed modules' with hooks. 1) don't treat them as 'allowed' - trace into them 2) graph-break, so the module is no longer part of the dynamo trace at all (1) will fail for users that opted into allowed modules becuase they know their module has problems being traced by dynamo. (2) causes graph breaks on common modules such as nn.Linear, just because they are marked as 'allowed'. It would help matters if we could differentiate between types of allowed modules (A) allowed to avoid overheads - used for common ops like nn.Linear (B) allowed to avoid dynamo graphbreaks caused by unsupported code Ideally, we'd use method (1) for group (A) and (2) for (B). For now, graph-break on all cases of allowed modules. Pull Request resolved: https://github.com/pytorch/pytorch/pull/97184 Approved by: https://github.com/jansel		2023-04-15 01:46:15 +00:00
..
_static	Move Dynamo docs back to core (#89769)	2022-11-29 04:38:53 +00:00
_templates	Add a private API banner (#93996)	2023-02-03 21:40:15 +00:00
community	[PT-D] Update CODEOWNERS, merge_rules, and Persons-of-Interest for to… (#96321)	2023-03-13 17:38:43 +00:00
compile	Graph-break on allowed modules if they have hooks (#97184)	2023-04-15 01:46:15 +00:00
elastic	[BE] Prefer dash over underscore in command-line options (#94505)	2023-02-09 20:16:49 +00:00
notes	Clarify the saving of intermediates in the "extending torch.func" docs (#98020)	2023-03-31 13:57:37 +00:00
rpc
scripts	Rename Canonical Aten IR to Core Aten IR (#92904)	2023-01-25 05:12:23 +00:00
_dynamo.rst	Add torch._dynamo to docs (#89510)	2022-11-23 16:33:13 +00:00
amp.rst	Remove deprecated torch.matrix_rank (#70981)	2022-09-22 17:40:46 +00:00
autograd.rst	[docs] Add missing functions to autograd.rst (#98854)	2023-04-11 20:45:49 +00:00
backends.rst	[CUDA][cuFFT] Minor fix for cuFFT plan cache docs (#96373)	2023-03-14 00:28:14 +00:00
benchmark_utils.rst
bottleneck.rst	add itt unit test and docstrings (#84848)	2022-09-28 01:39:58 +00:00
checkpoint.rst
complex_numbers.rst	Add a note on CUDA 11.6 (#80363)	2022-06-27 21:34:24 +00:00
conf.py	Add Symbool support in python to C++ translation (#98453)	2023-04-12 03:21:57 +00:00
config_mod.rst
cpp_extension.rst
cpp_index.rst
cuda._sanitizer.rst	Fix typos under docs directory (#88033)	2022-10-31 19:31:56 +00:00
cuda.rst	Add more GPU metric instrumentation (#91717)	2023-02-24 00:38:03 +00:00
cudnn_persistent_rnn.rst
cudnn_rnn_determinism.rst
data.rst	[DataLoader] Removing DataLoader2 related code (#88848)	2022-11-11 22:27:01 +00:00
ddp_comm_hooks.rst	[BE] [1/3] Rewrite super() calls in caffe2 and benchmarks (#94587)	2023-02-11 18:19:48 +00:00
deploy.rst	Delete torch::deploy from pytorch core (#85953)	2022-10-06 07:20:16 +00:00
distributed.algorithms.join.rst
distributed.checkpoint.rst	[DCP] Add DCP FSDP sharded_state_dict checkpoint example to DCP .rst file (#95517)	2023-03-03 18:09:10 +00:00
distributed.elastic.rst
distributed.optim.rst
distributed.rst	[Doc][Distributed] Add missing functions to distributed.rst (#89905)	2022-12-04 07:22:54 +00:00
distributed.tensor.parallel.rst	[PT-D][Sequence Parallelism] Enable DTensor based Naive sequence parallelism (#94369)	2023-02-16 21:21:00 +00:00
distributions.rst
dlpack.rst
docutils.conf
fft.rst
fsdp.rst	[FSDP()][3/N] Refactor public APIs (#87917)	2022-10-31 16:45:21 +00:00
func.api.rst	[functorch] linearize (#94173)	2023-02-09 15:45:08 +00:00
func.batch_norm.rst	Fix typo under docs directory (#97202)	2023-03-21 01:24:10 +00:00
func.migrating.rst	[torch.func] Add migration guide from functorch (#91811)	2023-01-17 22:14:42 +00:00
func.rst	Fix typo under docs directory (#92762)	2023-01-23 18:07:22 +00:00
func.ux_limitations.rst	[torch.func] Add docs (#91319)	2022-12-30 02:51:18 +00:00
func.whirlwind_tour.rst	[torch.func] Add docs (#91319)	2022-12-30 02:51:18 +00:00
futures.rst
fx.rst	prepare removal of deprecated functionality in torch.testing (#87969)	2022-11-02 14:04:48 +00:00
hub.rst	Fix typo under docs directory (#92762)	2023-01-23 18:07:22 +00:00
index.rst	Rework torch.compile docs (#96706)	2023-03-15 04:41:13 +00:00
ir.rst	Rename Canonical Aten IR to Core Aten IR (#92904)	2023-01-25 05:12:23 +00:00
jit_builtin_functions.rst
jit_language_reference_v2.rst	Fix typo under docs directory (#97202)	2023-03-21 01:24:10 +00:00
jit_language_reference.rst	[BE] [1/3] Rewrite super() calls in caffe2 and benchmarks (#94587)	2023-02-11 18:19:48 +00:00
jit_python_reference.rst
jit_unsupported.rst	(Re-open) Adds cudaMallocAsync as an alternative backend for the CUDA allocator (#82682)	2022-10-12 03:44:21 +00:00
jit_utils.rst	Create __init__.py (#78629)	2022-06-03 18:14:21 +00:00
jit.rst	[BE] [1/3] Rewrite super() calls in caffe2 and benchmarks (#94587)	2023-02-11 18:19:48 +00:00
library.rst	Add docs for Python Registration	2022-06-13 23:21:23 +00:00
linalg.rst	Add a note on the stability of linalg functions. (#88313)	2022-11-07 22:44:23 +00:00
masked.rst	Fix link in docs (#94686)	2023-02-13 20:42:24 +00:00
math-quantizer-equation.png
mobile_optimizer.rst	[Reland] Clean Up MobileOptimizerType Rewrite Flags Public API and Documentation (#92081)	2023-01-14 17:06:00 +00:00
model_zoo.rst
monitor.rst
mps.rst	[MPS] Enable Memory Leak Detection for test_mps.py (#94646)	2023-02-13 17:56:24 +00:00
multiprocessing.rst
name_inference.rst	Add itemsize and nbytes properties to Tensor (#98322)	2023-04-05 12:11:55 +00:00
named_tensor.rst	Add torch.unflatten and improve its docs (#81399)	2022-07-29 15:02:42 +00:00
nested.rst	Fix format bug in NT docs (#97998)	2023-03-31 01:00:25 +00:00
nn.functional.rst	[SDPA] update type hint for scaled_dot_product_attention and documentation (#94008)	2023-02-10 18:02:43 +00:00
nn.init.rst	update nn.init doc to reflect the no_grad (#80882)	2022-07-07 17:19:29 +00:00
nn.rst	[easy] Expose documentation for a few global nn.Module hooks (#97185)	2023-03-21 20:09:29 +00:00
onnx_diagnostics.rst	[ONNX] Document ONNX diagnostics (#88371)	2022-11-16 19:21:46 +00:00
onnx_supported_aten_ops.rst	[ONNX] Update ONNX documentation to include unsupported operators (#84496)	2022-09-16 23:48:37 +00:00
onnx.rst	[ONNX] Introduce Input/Ouptut adapter; Switch to 'DynamoExporter' (#98421)	2023-04-15 01:13:00 +00:00
optim.rst	[optim] Add general documentation on our algorithm defaults (#95391)	2023-02-24 21:35:30 +00:00
package.rst	Fix typos in torch.package documentation (#82994)	2022-08-08 20:19:17 +00:00
pipeline.rst	docs: Linking ResNeXt PyTorch Hub Pipeline (#98689)	2023-04-11 02:20:26 +00:00
profiler.rst	Fix ITT unit-tests if PyTorch is compiled with USE_ITT=OFF (#86199)	2022-10-04 21:57:05 +00:00
quantization-accuracy-debugging.rst	Fix typo under docs directory (#87583)	2022-10-24 23:52:44 +00:00
quantization-backend-configuration.rst	update quantization doc: add x86 backend as default backend of server inference (#86794)	2022-12-02 02:10:25 +00:00
quantization-support.rst	AO migration: migrate .rst files to new locations (#94211)	2023-02-07 02:32:23 +00:00
quantization.rst	Revert "[core][pruning][be] Rename sparsifier folder to pruner (#98758)"	2023-04-13 16:30:47 +00:00
random.rst
rpc.rst	Fix typo under docs directory and RELEASE.md (#85896)	2022-09-29 21:41:59 +00:00
signal.rst	Nuttall window (#90103)	2022-12-16 09:05:53 +00:00
sparse.rst	Minor error in docs regarding execution time (#93258)	2023-01-31 23:32:42 +00:00
special.rst	[primTorch] special: j0, j1, spherical_j0 (#86049)	2022-10-04 18:21:46 +00:00
storage.rst	Deprecate TypedStorage, its derived classes, and all of their public methods (#85303)	2022-11-08 18:11:01 +00:00
tensor_attributes.rst	Add a warning about performance cost of set_default_device (#92703)	2023-01-21 02:23:13 +00:00
tensor_view.rst
tensorboard.rst
tensors.rst	Add itemsize and nbytes properties to Tensor (#98322)	2023-04-05 12:11:55 +00:00
testing.rst	document torch.testing.assert_allclose (#89526)	2022-12-01 11:22:50 +00:00
torch.ao.ns._numeric_suite_fx.rst
torch.ao.ns._numeric_suite.rst
torch.overrides.rst
torch.rst	Rework torch.compile docs (#96706)	2023-03-15 04:41:13 +00:00
type_info.rst