6 Commits

Author	SHA1	Message	Date
Justin Chu	73e1455327	[BE] Enable ruff's UP rules and autoformat test/ (#105434) ... Pull Request resolved: https://github.com/pytorch/pytorch/pull/105434 Approved by: https://github.com/albanD	2023-07-19 20:36:06 +00:00
Edward Yang	36420b5e8c	Rename tools/codegen to torchgen (#76275) ... Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/76275 In preparation for addressing https://github.com/pytorch/pytorch/issues/73212 Diff was generated with: ``` git mv tools/codegen torchgen git grep -l 'tools.codegen' | xargs sed -i 's/tools.codegen/torchgen/g' sed -i "s/\${TOOLS_PATH}\/codegen/\${TORCH_ROOT}\/torchgen/g" caffe2/CMakeLists.txt ``` and a manual edits to: * tools/test/test_gen_backend_stubs.py * torchgen/build.bzl * torchgen/gen_backend_stubs.py aka this diff: ``` diff --git a/tools/test/test_gen_backend_stubs.py b/tools/test/test_gen_backend_stubs.py index 3dc26c6d2d..104054575e 100644 --- a/tools/test/test_gen_backend_stubs.py +++ b/tools/test/test_gen_backend_stubs.py @@ -9,7 +9,7 @@ from torchgen.gen_backend_stubs import run from torchgen.gen import _GLOBAL_PARSE_NATIVE_YAML_CACHE # noqa: F401 path = os.path.dirname(os.path.realpath(__file__)) -gen_backend_stubs_path = os.path.join(path, '../torchgen/gen_backend_stubs.py') +gen_backend_stubs_path = os.path.join(path, '../../torchgen/gen_backend_stubs.py') # gen_backend_stubs.py is an integration point that is called directly by external backends. # The tests here are to confirm that badly formed inputs result in reasonable error messages. diff --git a/torchgen/build.bzl b/torchgen/build.bzl index ed04e35a43..d00078a3cf 100644 --- a/torchgen/build.bzl +++ b/torchgen/build.bzl @@ -1,6 +1,6 @@ def define_targets(rules): rules.py_library( - name = "codegen", + name = "torchgen", srcs = rules.glob(["**/*.py"]), deps = [ rules.requirement("PyYAML"), @@ -11,6 +11,6 @@ def define_targets(rules): rules.py_binary( name = "gen", - srcs = [":codegen"], + srcs = [":torchgen"], visibility = ["//visibility:public"], ) diff --git a/torchgen/gen_backend_stubs.py b/torchgen/gen_backend_stubs.py index c1a672a655..beee7a15e0 100644 --- a/torchgen/gen_backend_stubs.py +++ b/torchgen/gen_backend_stubs.py @@ -474,7 +474,7 @@ def run( ) -> None: # Assumes that this file lives at PYTORCH_ROOT/torchgen/gen_backend_stubs.py - pytorch_root = pathlib.Path(__file__).parent.parent.parent.absolute() + pytorch_root = pathlib.Path(__file__).parent.parent.absolute() template_dir = os.path.join(pytorch_root, "aten/src/ATen/templates") def make_file_manager(install_dir: str) -> FileManager: ``` run_all_fbandroid_tests Test Plan: sandcastle Reviewed By: albanD, ngimel Differential Revision: D35770317 fbshipit-source-id: 153ac4a7fef15b1e750812a90bfafdbc8f1ebcdf (cherry picked from commit c6d485d1d4648fa1c8a4c14c5bf3d8e899b9b4dd)	2022-04-25 01:38:06 +00:00
Chen Lai	784bd92340	Use upgrader_mobile.cpp as the reference for codegen unittest (#71930) ... Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/71930 Previously `fbcode/caffe2/test/mobile/test_upgrader_bytecode_table_example.cpp` was checked in as intermediate step to make sure upgrader codegen works properly, before upgrader codegen is actually being used. this change use `buck run mode/opt //caffe2/torch/fb/mobile/upgrader_codegen:upgrader_codegen` to codegen `upgrader_mobile.cpp` and we no longer need to use the checkin file `test_upgrader_bytecode_table_example.cpp` for the codegen unit test. ghstack-source-id: 147957826 Test Plan: ``` buck test mode/opt //caffe2/test:upgrader_codegen ``` Reviewed By: tugsbayasgalan Differential Revision: D33746264 fbshipit-source-id: 18de3cae53aed966e67f8dc42976a2d10d3788b3 (cherry picked from commit 661ffa7860)	2022-01-30 03:11:32 +00:00
Tugsbayasgalan (Tugsuu) Manlaibaatar	e849c8b0f2	Move bytecode generation to python (#71681) ... Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/71681 Test Plan: Imported from OSS Reviewed By: gmagogsfm, cccclai Differential Revision: D33730791 Pulled By: tugsbayasgalan fbshipit-source-id: e752e9ae20c01a57a3bea270f604215fdcc9182e (cherry picked from commit 69c9dc0548)	2022-01-28 02:33:00 +00:00
Tugsbayasgalan (Tugsuu) Manlaibaatar	c9bd1c60ed	Move upgraders from python to cpp (#70593) ... Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/70593 Test Plan: Imported from OSS Reviewed By: gmagogsfm Differential Revision: D33402543 Pulled By: tugsbayasgalan fbshipit-source-id: 713c54fbbb2bc4c96d5e3b6084f3090a8923a12d (cherry picked from commit e72b375264)	2022-01-22 00:24:24 +00:00
Chen Lai	b23890177f	[Operator Versioning][Edge] Codegen upgrader_mobile.cpp (#69194) ... Summary: From operator version map and upgrader torchscript, generate upgrader_mobile.cpp file. It also includes a unit test. Pull Request resolved: https://github.com/pytorch/pytorch/pull/69194 ghstack-source-id: 145819351 Test Plan: ``` buck test mode/opt //caffe2/test:upgrader_codegen ``` ``` buck run mode/opt //caffe2/torch/fb/mobile/upgrader_codegen:upgrader_codegen ``` ``` python /Users/chenlai/pytorch/tools/codegen/operator_versions/gen_mobile_upgraders.py ``` Reviewed By: iseeyuan Differential Revision: D32748985 fbshipit-source-id: f8437766edaba459bfc5e7fc7a3ca0520c4edb9a	2021-12-16 10:29:35 -08:00