Xuehai Pan
b005ec62b9
[BE] Remove dependency on six and future ( #94709 )
...
Remove the Python 2 and 3 compatibility library [six](https://pypi.org/project/six ) and [future](https://pypi.org/project/future ) and `torch._six`. We only support Python 3.8+ now. It's time to retire them.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/94709
Approved by: https://github.com/malfet , https://github.com/Skylion007
2023-02-14 09:14:14 +00:00
Maxwell Nuyens
0d0ebcdfe5
feature: adding the ability to restore shapes after loading a traced model ( #90744 )
...
Adds the ability to store inputs used in tracing models when calling torch.jit.save and restore the input shapes using torch.jit.load if the appropriate variables are set.
Fixes [89185](https://github.com/pytorch/pytorch/issues/89185 )
Pull Request resolved: https://github.com/pytorch/pytorch/pull/90744
Approved by: https://github.com/davidberard98
2023-02-10 17:12:52 +00:00
Aaron Gokaslan
1e2d82b8e4
[BE] Merge isinstance calls together ( #94419 )
...
Simplify and speeds up isinstance calls by checking for multiple types at the same time.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/94419
Approved by: https://github.com/ezyang
2023-02-09 00:47:26 +00:00
Ian Graves
b3ca7fc88d
Support saving extra files in pytorch flat buffer format via python ( #77870 )
...
Summary: The extra files serialization paths were not exposed to the python layer for flat buffers, this diff does just that.
Reviewed By: qihqi
Differential Revision: D36469535
Pull Request resolved: https://github.com/pytorch/pytorch/pull/77870
Approved by: https://github.com/qihqi
2022-05-19 22:15:17 +00:00
Han Qi (qihqi)
3822a472ef
Python function to extract information on mobile::Module from flatbuffer ( #77624 )
...
Summary:
Includes following refactor:
1. common loading on operator validation that is dup'd in pickle and
flatbuffer loader moved to function.h/cpp
2. Allow loading of a function without wiring operator.
This function will be used to implement get_bundled_input and friends
for flatbuffer.
Test Plan: contbuild & OSS CI, see 69fa49f123
Reviewed By: cccclai
Differential Revision: D36348549
Pull Request resolved: https://github.com/pytorch/pytorch/pull/77624
Approved by: https://github.com/cccclai
2022-05-18 00:42:57 +00:00
PyTorch MergeBot
5e3e5a5403
Revert "Python function to extract information on mobile::Module from flatbuffer ( #77328 )"
...
This reverts commit 69fa49f123 .
Reverted https://github.com/pytorch/pytorch/pull/77328 on behalf of https://github.com/atalman
2022-05-17 01:35:05 +00:00
Han Qi (qihqi)
69fa49f123
Python function to extract information on mobile::Module from flatbuffer ( #77328 )
...
Includes following refactor:
1. common loading on operator validation that is dup'd in pickle and
flatbuffer loader moved to function.h/cpp
2. Allow loading of a function without wiring operator.
This function will be used to implement get_bundled_input and friends
for flatbuffer.
Fixes #ISSUE_NUMBER
Pull Request resolved: https://github.com/pytorch/pytorch/pull/77328
Approved by: https://github.com/cccclai
2022-05-16 16:58:43 +00:00
Han Qi
75d6cbe605
[4/5]Testing jit module in flatbuffer in Python. ( #74387 )
...
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/74387
Make temporary python bindings for flatbuffer to test ScriptModule save / load.
(Note: this ignores all push blocking failures!)
Test Plan: unittest
Reviewed By: iseeyuan
Differential Revision: D34968080
fbshipit-source-id: d23b16abda6e4b7ecf6b1198ed6e00908a3db903
(cherry picked from commit 5cbbc390c5f54146a1c469106ab4a6286c754325)
2022-03-24 23:29:47 +00:00
Tugsbayasgalan (Tugsuu) Manlaibaatar
b0fdca8855
Bump version number to 7 and compile old operators with old schema ( #68358 )
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/68358
Test Plan: Imported from OSS
Reviewed By: albanD
Differential Revision: D33433730
Pulled By: tugsbayasgalan
fbshipit-source-id: 202c58365bae13195d3545cefcb0da9162b02151
2022-01-05 23:57:22 -08:00
Michael Suo
0ece9a49d7
Revert D33198155: Bump version number to 7 and compile old operators with old schema
...
Test Plan: revert-hammer
Differential Revision:
D33198155 (d35fc409ad )
Original commit changeset: 38a1185f9ecb
Original Phabricator Diff: D33198155 (d35fc409ad )
fbshipit-source-id: 411aaeb4e047aad9202db50d4d0f2ff35bc51f9d
2022-01-04 13:44:59 -08:00
Tugsbayasgalan (Tugsuu) Manlaibaatar
d35fc409ad
Bump version number to 7 and compile old operators with old schema ( #68358 )
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/68358
Test Plan: Imported from OSS
Reviewed By: samdow
Differential Revision: D33198155
Pulled By: tugsbayasgalan
fbshipit-source-id: 38a1185f9ecb34a33f737ad0b060b3490956300c
2022-01-04 01:31:25 -08:00
Tugsbayasgalan (Tugsuu) Manlaibaatar
20f7c893c1
Populate runtime with upgrader graph ( #68773 )
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/68773
Test Plan: Imported from OSS
Reviewed By: qihqi, gmagogsfm
Differential Revision: D32603258
Pulled By: tugsbayasgalan
fbshipit-source-id: 6fa0b7ee4ebe46c9aa148923c6ef3e1de106ad13
2021-12-11 13:44:24 -08:00
Sam Estep
75024e228c
Add lint for unqualified type: ignore ( #56290 )
...
Summary:
The other half of https://github.com/pytorch/pytorch/issues/56272 .
Pull Request resolved: https://github.com/pytorch/pytorch/pull/56290
Test Plan:
CI should pass on the tip of this PR, and we know that the lint works because the following CI runs (before this PR was finished) failed:
- https://github.com/pytorch/pytorch/runs/2384511062
- https://github.com/pytorch/pytorch/actions/runs/765036024
Reviewed By: seemethere
Differential Revision: D27867219
Pulled By: samestep
fbshipit-source-id: e648f07b6822867e70833e23ddafe7fb7eaca235
2021-04-21 08:07:23 -07:00
Samuel Marks
e6779d4357
[*.py] Rename "Arguments:" to "Args:" ( #49736 )
...
Summary:
I've written custom parsers and emitters for everything from docstrings to classes and functions. However, I recently came across an issue when I was parsing/generating from the TensorFlow codebase: inconsistent use of `Args:` and `Arguments:` in its docstrings.
```sh
(pytorch#c348fae)$ for name in 'Args:' 'Arguments:'; do
printf '%-10s %04d\n' "$name" "$(rg -IFtpy --count-matches "$name" | paste -s -d+ -- | bc)"; done
Args: 1095
Arguments: 0336
```
It is easy enough to extend my parsers to support both variants, however it looks like `Arguments:` is wrong anyway, as per:
- https://google.github.io/styleguide/pyguide.html#doc-function-args @ [`ddccc0f`](https://github.com/google/styleguide/blob/ddccc0f/pyguide.md )
- https://chromium.googlesource.com/chromiumos/docs/+/master/styleguide/python.md#describing-arguments-in-docstrings @ [`9fc0fc0`](https://chromium.googlesource.com/chromiumos/docs/+/9fc0fc0/styleguide/python.md )
- https://sphinxcontrib-napoleon.readthedocs.io/en/latest/example_google.html @ [`c0ae8e3`](https://github.com/sphinx-contrib/napoleon/blob/c0ae8e3/docs/source/example_google.rst )
Therefore, only `Args:` is valid. This PR replaces them throughout the codebase.
PS: For related PRs, see tensorflow/tensorflow/pull/45420
PPS: The trackbacks automatically appearing below are sending the same changes to other repositories in the [PyTorch](https://github.com/pytorch ) organisation.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/49736
Reviewed By: albanD
Differential Revision: D25710534
Pulled By: soumith
fbshipit-source-id: 61e8ff01abb433e9f78185c2d1d0cbd7c22c1619
2020-12-28 09:34:47 -08:00
Jonathan Conder
9dc9a55bc4
Fix TypeError when torch.jit.load is passed a pathlib.Path ( #45825 )
...
Summary:
Fixes https://github.com/pytorch/pytorch/issues/45824
Pull Request resolved: https://github.com/pytorch/pytorch/pull/45825
Reviewed By: VitalyFedyunin
Differential Revision: D24129441
Pulled By: gmagogsfm
fbshipit-source-id: 52a76e39c163206cee2d19967e333e948adefe99
2020-10-08 01:29:29 -07:00
Guilherme Leobas
cdf5e2ae86
add typing annotations for a few torch.utils.* modules ( #43806 )
...
Summary:
Fixes https://github.com/pytorch/pytorch/issues/43431 . Depends on [gh-43862](https://github.com/pytorch/pytorch/pull/43862 ) (EDIT: now merged)
Modules:
- torch.utils.mkldnn
- torch.utils.mobile_optimizer
- torch.utils.bundled_inputs
Pull Request resolved: https://github.com/pytorch/pytorch/pull/43806
Reviewed By: gmagogsfm
Differential Revision: D23635151
Pulled By: SplitInfinity
fbshipit-source-id: a85b75a7927dde6cc55bcb361f8ff601ffb0b2a1
2020-09-11 10:20:55 -07:00
Meghan Lele
7816d53798
[JIT] Add mypy type annotations for JIT ( #43862 )
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/43862
Test Plan: Imported from OSS
Reviewed By: eellison
Differential Revision: D23491151
Pulled By: SplitInfinity
fbshipit-source-id: 88367b89896cf409bb9ac3db7490d6779efdc3a4
2020-09-03 15:09:24 -07:00
Dmytro Dzhulgakov
47e489b135
Make ExtraFilesMap return bytes instead of str ( #43241 )
...
Summary:
In case we want to store binary files using `ScriptModule.save(..., _extra_files=...)` functionality. With python3 we can just use bytes only and not bother about it.
I had to do a copy-pasta from pybind sources, maybe we should upstream it, but it'd mean adding a bunch of template arguments to `bind_map` which is a bind untidy.
Let me know if there's a better place to park this function (it seems to be the only invocation of `bind_map` so I put it in the same file)
Pull Request resolved: https://github.com/pytorch/pytorch/pull/43241
Reviewed By: zdevito
Differential Revision: D23205244
Pulled By: dzhulgakov
fbshipit-source-id: 8f291eb4294945fe1c581c620d48ba2e81b3dd9c
2020-08-28 19:11:33 -07:00
Michael Suo
62cee0001e
Move async + serialization implementation out of 'jit/__init__.py' ( #41018 )
...
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/41018
See https://github.com/pytorch/pytorch/pull/40807 for context.
Test Plan: Imported from OSS
Reviewed By: ailzhang
Differential Revision: D22393869
Pulled By: suo
fbshipit-source-id: a71cc571a423ccb81cd148444dc2a18d2ee43464
2020-07-09 10:10:01 -07:00