Yanbo Liang
e4ccec6eca
[Dynamo] Fix bug of using customized torch.autograd.Function ( #89397 )
...
Fixes https://github.com/pytorch/torchdynamo/issues/1899
Pull Request resolved: https://github.com/pytorch/pytorch/pull/89397
Approved by: https://github.com/jansel
2022-11-24 05:28:58 +00:00
Michael Lazos
85a87e635c
[dynamo] mutable local caching to make dynamo faster at tracing mutation ( #89170 )
...
Make mutation faster to speed up tracing optimizers, helps with https://github.com/pytorch/torchdynamo/issues/1803
`replace_all` no longer iterates over the entire variable tracker data structure every time a mutation is performed
Each variable tracker internally keeps a set of contained mutable variable trackers, to provide a hint to `replace_all`. This is populated with a call to `apply` from `__post_init__` in the base `VariableTracker`
Pull Request resolved: https://github.com/pytorch/pytorch/pull/89170
Approved by: https://github.com/jansel
2022-11-19 01:47:48 +00:00
Yanbo Liang
b72f5b9ae3
[Dynamo] Support typing.Mapping & Support function as argument ( #88963 )
...
These missing features come from https://github.com/pytorch/benchmark/pull/1302 , where we'd like to enable E2E hf_bert dynamo train/eval. The dependent [HuggingFace accelerate library](https://huggingface.co/docs/accelerate/index ) requires these improvements.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/88963
Approved by: https://github.com/jansel
2022-11-17 06:57:42 +00:00
Yanbo Liang
848e7240a1
[Dynamo] Add a dummy profiler to avoid activating real profiler ( #88930 )
...
See context at https://github.com/pytorch/torchdynamo/issues/1721#issuecomment-1312396059
Pull Request resolved: https://github.com/pytorch/pytorch/pull/88930
Approved by: https://github.com/jansel
2022-11-16 19:08:49 +00:00
Michael Voznesensky
06ce1338bc
[dynamo] Port all pytorch/dynamo and test/dynamo pieces over from symbolic-shapes branch ( #88768 )
...
Pull Request resolved: https://github.com/pytorch/pytorch/pull/88768
Approved by: https://github.com/jansel , https://github.com/ezyang
2022-11-13 04:50:21 +00:00
PyTorch MergeBot
ba4d5aae06
Revert "rename DisableTorchFunction to DisableTorchFunctionSubclass ( #88218 )"
...
This reverts commit 7f28be10e5https://github.com/pytorch/pytorch/pull/88218 on behalf of https://github.com/izaitsevfb due to BC-breaking change, D41211901
2022-11-11 19:13:05 +00:00
samdow
7f28be10e5
rename DisableTorchFunction to DisableTorchFunctionSubclass ( #88218 )
...
First half of #87990 . This doesn't change any of the behavior and is just a rename
Pull Request resolved: https://github.com/pytorch/pytorch/pull/88218
Approved by: https://github.com/ezyang , https://github.com/zou3519
2022-11-10 14:51:13 +00:00
Yanbo Liang
bd1ffc6501
[Dynamo] Fix bug: GradMode doesn't carry grad state correctly after graph break ( #88537 )
...
Fixes https://github.com/pytorch/torchdynamo/issues/1446
Pull Request resolved: https://github.com/pytorch/pytorch/pull/88537
Approved by: https://github.com/jansel
2022-11-07 18:03:31 +00:00
PyTorch MergeBot
f3cc588d09
Revert "Dynamo FX graph stack traceback fix ( #87136 )"
...
This reverts commit 89e6078bc3https://github.com/pytorch/pytorch/pull/87136 on behalf of https://github.com/clee2000 due to causing a lot of tests to fail on master even though pr is green
2022-10-19 18:57:24 +00:00
William Wen
89e6078bc3
Dynamo FX graph stack traceback fix ( #87136 )
...
Migration from https://github.com/pytorch/torchdynamo/pull/1655 .
Pull Request resolved: https://github.com/pytorch/pytorch/pull/87136
Approved by: https://github.com/voznesenskym
2022-10-19 17:15:43 +00:00
Jason Ansel
c7c09722ad
Move TorchDynamo into PyTorch core ( #86461 )
...
Context:
https://github.com/pytorch/torchdynamo/issues/1588
This PR moves [TorchDynamo](https://github.com/pytorch/torchdynamo ) and TorchInductor into PyTorch core.
- `torchdynamo` becomes `torch._dynamo`
- `torchinductor` becomes `torch._inductor`
This PR was generated by running `copy_to_core.sh` in https://github.com/pytorch/torchdynamo/pull/1538
Pull Request resolved: https://github.com/pytorch/pytorch/pull/86461
Approved by: https://github.com/voznesenskym
2022-10-13 23:18:06 +00:00
