PyTorch MergeBot
fe05266fda
Revert "[reland][inductor] Add an AOT compilation mode for Inductor CPP backend ( #95985 )"
...
This reverts commit deaf9e5e65https://github.com/pytorch/pytorch/pull/95985 on behalf of https://github.com/huydhn due to Sorry for reverting this. It increased the test time significantly for ASAN (and may be other test shards). ASAN tests on PR passed but it was barely not timing out. I have updated my initial findings in https://github.com/pytorch/pytorch/issues/96378
2023-03-09 01:45:24 +00:00
Bin Bao
deaf9e5e65
[reland][inductor] Add an AOT compilation mode for Inductor CPP backend ( #95985 )
...
Summary: This is a reland of https://github.com/pytorch/pytorch/pull/94822
Pull Request resolved: https://github.com/pytorch/pytorch/pull/95985
Approved by: https://github.com/jansel
2023-03-08 20:02:32 +00:00
PyTorch MergeBot
879400e4e8
Revert "[inductor] Add an AOT compilation mode for Inductor CPP backend ( #94822 )"
...
This reverts commit 73b66098b2https://github.com/pytorch/pytorch/pull/94822 on behalf of https://github.com/clee2000 due to broke inductor_tmm_cpu_accuracy, 73b66098b2 (11745396725)
2023-03-03 17:33:27 +00:00
Bin Bao
73b66098b2
[inductor] Add an AOT compilation mode for Inductor CPP backend ( #94822 )
...
Summary: The AOT mode currently works for the CPP backend. When turned on, Inductor compiles the model code into a .so file with aot_inductor_entry as the entry function. If the AOT compilation fails, Inductor will explicitly fail.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/94822
Approved by: https://github.com/jansel
2023-03-03 14:18:09 +00:00
Edward Z. Yang
ca9ebf9e2b
Delete dynamo_import and inductor_import ( #93851 )
...
Signed-off-by: Edward Z. Yang <ezyang@meta.com>
Pull Request resolved: https://github.com/pytorch/pytorch/pull/93851
Approved by: https://github.com/albanD , https://github.com/jansel
2023-02-02 01:51:29 +00:00
Jason Ansel
8c09a005c5
[inductor] Pattern matching engine (copy) ( #93291 )
...
This is an exact duplicate of https://github.com/pytorch/pytorch/pull/90739
The fbcode workflow for landing that diff seems buggy. The github-export-checks task is failing with credentials errors. Plan to try to land it using GH1.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/93291
Approved by: https://github.com/desertfire
2023-01-31 04:51:00 +00:00
Michael Lazos
6f1727b288
Print aot graphs if user specifies aot graph env vars ( #92720 )
...
When integrating AOT logging with TorchInductor trace, the ability to print graphs to the console if the user specified any of the env vars was removed (in favor of using TORCH_COMPILE_DEBUG). This restores this by checking if the user set any of the aot debug variables *before* setting up the remainder of the logging, and adding a stream to stdout if any of those env vars are set.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/92720
Approved by: https://github.com/Chillee
2023-01-21 04:46:35 +00:00
Jason Ansel
9b173b87b2
Refactor away leftover import indirection ( #92188 )
...
This indirect ways of importing are a leftover from when we wanted to support both `import torchdynamo` and `import torch._dynamo`
Pull Request resolved: https://github.com/pytorch/pytorch/pull/92188
Approved by: https://github.com/desertfire
2023-01-18 04:53:05 +00:00
Jason Ansel
7c1c239db1
[inductor] Rewrite Triton templates + epilogue fusion (retry) ( #91575 )
...
This reverts commit 94262efc7d#91105 / #90738 .
Fixes https://github.com/pytorch/torchdynamo/issues/2015
Pull Request resolved: https://github.com/pytorch/pytorch/pull/91575
Approved by: https://github.com/ngimel
2023-01-11 00:08:03 +00:00
PyTorch MergeBot
94262efc7d
Revert "[inductor] Rewrite Triton templates + epilogue fusion (retry) ( #91105 )"
...
This reverts commit d6dd2e97dahttps://github.com/pytorch/pytorch/pull/91105 on behalf of https://github.com/atalman due to Broke internal builds
2022-12-21 00:02:38 +00:00
Jason Ansel
d6dd2e97da
[inductor] Rewrite Triton templates + epilogue fusion (retry) ( #91105 )
...
https://github.com/pytorch/pytorch/pull/90738 seems a bit borked. ghimport fails on it, and I unlinked it from the Phabricator diff, but it still won't land. This is an exact copy that PR without using ghstack.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/91105
Approved by: https://github.com/ngimel
2022-12-20 02:38:23 +00:00
Edward Z. Yang
0b3316ad2c
Don't enable debug_fake_crossref for TORCH_COMPILE_DEBUG ( #90666 )
...
It is kind of flaky, it doesn't work with dynamic shapes, and I think the debug interpreter is a better way to detect if you've had a size/stride propagation accident.
Fixes https://github.com/pytorch/pytorch/issues/90652
Signed-off-by: Edward Z. Yang <ezyang@fb.com>
Pull Request resolved: https://github.com/pytorch/pytorch/pull/90666
Approved by: https://github.com/voznesenskym
2022-12-12 14:20:40 +00:00
Bert Maher
b95ea4f149
[pt2] Reset dynamo log level when exiting inductor debug context ( #90473 )
...
When entering an inductor debug context we increase the log level of
dynamo; I guess this makes sense, since if we're debugging inductor, and
inductor calls into dynamo, we probably want visibility into what dynamo is
doing.
But when we exit that context, we probably want to go back to whatever level of
dynamo-specific logging was in place before. Dynamo generates lots of debug
info (guards, bytecode), and it's a lot to sift through if you're not
specifically interested in it.
Differential Revision: [D41841879](https://our.internmc.facebook.com/intern/diff/D41841879/ )
Differential Revision: [D41841879](https://our.internmc.facebook.com/intern/diff/D41841879 )
Pull Request resolved: https://github.com/pytorch/pytorch/pull/90473
Approved by: https://github.com/mlazos , https://github.com/jansel
2022-12-12 04:39:37 +00:00
Michael Lazos
730e44bbc7
Add logging for aot autograd and unified debug flag ( #88987 )
...
- Adds `log_level` to aot's config
- Outputs log to `<graph_name>_<log_level>.log` in aot_torchinductor subfolder of the debug directory
- Modifies the Inductor debug context to use the graph name when naming the folder instead of the os pid
- Adds `TORCH_COMPILE_DEBUG` flag to enable it, (as well as separate dynamo and inductor logs)
Pull Request resolved: https://github.com/pytorch/pytorch/pull/88987
Approved by: https://github.com/Chillee
2022-12-09 17:28:10 +00:00
Horace He
e150a6212b
Added gm.print_readable to torchinductor_trace output ( #87717 )
...
cc @jansel @mlazos @soumith @voznesenskym @yanboliang @penguinwu @anijain2305
Pull Request resolved: https://github.com/pytorch/pytorch/pull/87717
Approved by: https://github.com/ngimel
2022-10-25 22:31:49 +00:00
Michael Lazos
8461460d55
Unified debug directory for dynamo/inductor tools ( #87438 )
...
Fixes https://github.com/pytorch/torchdynamo/issues/1705
Fixes https://github.com/pytorch/torchdynamo/issues/1383
Adds a debug directory by default called `torchdynamo_debug` in the current working directory.
In the debug directory for each run of dynamo (an enter and exit of optimize) folder run_\<timestamp\> is created which contains any minifier/inductor/torchdynamo artifacts under respective folders.
Updated the minifier, record replay, and inductor tracing to use this directory
cc @jansel @lezcano @fdrocha @soumith @voznesenskym @yanboliang
Pull Request resolved: https://github.com/pytorch/pytorch/pull/87438
Approved by: https://github.com/soumith
2022-10-22 03:43:11 +00:00
Jason Ansel
c7c09722ad
Move TorchDynamo into PyTorch core ( #86461 )
...
Context:
https://github.com/pytorch/torchdynamo/issues/1588
This PR moves [TorchDynamo](https://github.com/pytorch/torchdynamo ) and TorchInductor into PyTorch core.
- `torchdynamo` becomes `torch._dynamo`
- `torchinductor` becomes `torch._inductor`
This PR was generated by running `copy_to_core.sh` in https://github.com/pytorch/torchdynamo/pull/1538
Pull Request resolved: https://github.com/pytorch/pytorch/pull/86461
Approved by: https://github.com/voznesenskym
2022-10-13 23:18:06 +00:00
