Elias Ellison
9c144bc4fe
Dont increment generation if forward of backward exists, and warning on deallocation of live tensors ( #97168 )
...
Refining the logic for when it is okay to ignore previously live outputs from cudagraphs. If there is a forward that has been invoked without invocation of the corresponding backwards, dont allow overwriting outputs.
Differential Revision: [D44228369](https://our.internmc.facebook.com/intern/diff/D44228369 )
Pull Request resolved: https://github.com/pytorch/pytorch/pull/97168
Approved by: https://github.com/ezyang , https://github.com/jansel
2023-03-22 18:27:36 +00:00
Brian Hirsh
7a076b7b93
[aot_autograd] only performance functionalization analysis pass once ( #95992 )
...
For a while now, we've been re-running our functionalization analysis pass twice - once for get metadata when dedup'ing, and an entire second time during aot_dispatch_base/autograd.
This should also probably speed up compile times pretty noticeably, since we're going from:
(a) inference-only trace case: 3 fw traces -> 2 fw traces
(b) autograd trace case: 2 fw traces + 1 joint trace -> 1 fw trace + 1 joint trace
Pull Request resolved: https://github.com/pytorch/pytorch/pull/95992
Approved by: https://github.com/ezyang
2023-03-15 13:45:40 +00:00
Jiayi Sun
5fe72b8716
[Dynamo] modify dynamo ipex backend ( #94169 )
...
1. Extend fake_tensor_unsupported to support dynamic shapes mode.
2. Use fake_tensor_unsupported in dynamo ipex backend.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/94169
Approved by: https://github.com/jgong5 , https://github.com/jansel
2023-02-08 05:10:42 +00:00
Jason Ansel
0a93e6db5a
Fix/refactor dynamo ipex backend ( #93863 )
...
Pull Request resolved: https://github.com/pytorch/pytorch/pull/93863
Approved by: https://github.com/desertfire
2023-02-03 21:42:27 +00:00
Jason Ansel
a5ff40032d
Fix/refactor dynamo onnxrt backend ( #93818 )
...
Fixes https://github.com/pytorch/pytorch/issues/90352
Pull Request resolved: https://github.com/pytorch/pytorch/pull/93818
Approved by: https://github.com/voznesenskym
2023-02-03 20:48:02 +00:00
Jason Ansel
60e8c766b5
Refactor dynamo training backends ( #93409 )
...
This splits training.py into many files and moves them from `dynamo.optimizations.training` to `dynamo.backends.*`.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/93409
Approved by: https://github.com/ezyang
2023-02-03 03:07:15 +00:00
