pytorch/tools
Catherine Lee 32ac38f85d [lint] workflow consistency linter to look at all files instead of just changed files (#165171)
As in title

If you change only one workflow file, lintrunner (default arg, also the one in CI since it only inputs changed files) won't look at other files in the repo, but the sync-tag might come from those other files

This makes it so that it looks at all workflow files so it will catch those failures

Also change output line so it prints which file + which job it is different from

Pros:
catches errors

Cons:
unusual behavior (getting around what lintrunner says the linter should run on)
Pull Request resolved: https://github.com/pytorch/pytorch/pull/165171
Approved by: https://github.com/malfet, https://github.com/izaitsevfb, https://github.com/atalman
2025-10-24 21:43:18 +00:00
..
alerts More ruff SIM fixes (#164695) 2025-10-09 03:24:50 +00:00
amd_build [Submodule] Bump FBGEMM to latest (#165544) 2025-10-22 20:57:15 +00:00
autograd [MPS] Fix parity between CPU and MPS on singular matrices in linalg.lu_factor (#165871) 2025-10-22 02:48:40 +00:00
bazel_tools [BE] fix typos in tools/ (#156082) 2025-06-17 19:25:50 +00:00
build/bazel [CI] update flake8 and mypy lint dependencies (#158720) 2025-07-29 08:05:56 +00:00
build_defs [BE] fix typos in tools/ (#156082) 2025-06-17 19:25:50 +00:00
code_analyzer [BE] fix typos in tools/ (#156082) 2025-06-17 19:25:50 +00:00
code_coverage Expand type checking to mypy strict files (#165697) 2025-10-18 04:34:45 +00:00
config [BE] fix typos in tools/ (#156082) 2025-06-17 19:25:50 +00:00
coverage_plugins_package More ruff SIM fixes (#164695) 2025-10-09 03:24:50 +00:00
dynamo Expand type checking to mypy strict files (#165697) 2025-10-18 04:34:45 +00:00
experimental/torchfuzz Add type suppressions to _inductor/runtime (#165918) 2025-10-21 02:54:22 +00:00
flight_recorder update fr trace analysis (#165994) 2025-10-21 19:14:33 +00:00
gdb Expand type checking to mypy strict files (#165697) 2025-10-18 04:34:45 +00:00
github [9/N] Apply ruff UP035 rule (#165515) 2025-10-17 00:09:51 +00:00
iwyu
jit Expand type checking to mypy strict files (#165697) 2025-10-18 04:34:45 +00:00
linter [lint] workflow consistency linter to look at all files instead of just changed files (#165171) 2025-10-24 21:43:18 +00:00
lite_interpreter Expand type checking to mypy strict files (#165697) 2025-10-18 04:34:45 +00:00
lldb [BE] Remove torch deploy | remove torch deploy specific files (#158290) 2025-07-30 01:36:03 +00:00
packaging Enable all flake8-logging-format rules (#164655) 2025-10-19 00:59:28 +00:00
pyi Expand type checking to mypy strict files (#165697) 2025-10-18 04:34:45 +00:00
rules
rules_cc
setup_helpers Expand type checking to mypy strict files (#165697) 2025-10-18 04:34:45 +00:00
shared
stats Expand type checking to mypy strict files (#165697) 2025-10-18 04:34:45 +00:00
test Enable PLC0414 on ruff (#165828) 2025-10-22 04:56:52 +00:00
testing Enable PLC0414 on ruff (#165828) 2025-10-22 04:56:52 +00:00
__init__.py
bazel.bzl Move version.h to torch/headeronly (#164381) 2025-10-07 17:47:30 +00:00
BUCK.bzl [BE] Cleanup old ExecuTorch codegen and runtime code (#154165) 2025-06-07 06:54:12 +00:00
BUCK.oss
build_libtorch.py
build_pytorch_libs.py Revert "[RELAND] Always build USE_DISTRIBUTED (#160449) and Make distributed modules importable even when backend not built (#159889) (#162594)" 2025-09-25 13:47:46 +00:00
build_with_debinfo.py [build] modernize build-frontend: python setup.py develop/install -> [uv ]pip install --no-build-isolation [-e ]. (#156027) 2025-07-09 11:24:27 +00:00
download_mnist.py Expand type checking to mypy strict files (#165697) 2025-10-18 04:34:45 +00:00
extract_scripts.py mypy 1.16.0 (#155821) 2025-06-14 18:18:43 +00:00
gen_flatbuffers.sh
gen_vulkan_spv.py Expand type checking to mypy strict files (#165697) 2025-10-18 04:34:45 +00:00
generate_torch_version.py Add sdist handling to version finding (#160315) 2025-09-25 07:15:51 +00:00
generated_dirs.txt
git_add_generated_dirs.sh
git_reset_generated_dirs.sh
nightly_hotpatch.py Expand type checking to mypy strict files (#165697) 2025-10-18 04:34:45 +00:00
nightly.py Expand type checking to mypy strict files (#165697) 2025-10-18 04:34:45 +00:00
nvcc_fix_deps.py [BE] fix typos in tools/ (#156082) 2025-06-17 19:25:50 +00:00
optional_submodules.py [BE] Make Eigen an optional dependency (#155955) 2025-06-21 03:02:02 +00:00
README.md
render_junit.py
substitute.py
update_masked_docs.py
vscode_settings.py

This folder contains a number of scripts which are used as part of the PyTorch build process. This directory also doubles as a Python module hierarchy (thus the __init__.py).

Overview

Modern infrastructure:

  • autograd - Code generation for autograd. This includes definitions of all our derivatives.
  • jit - Code generation for JIT
  • shared - Generic infrastructure that scripts in tools may find useful.
    • module_loader.py - Makes it easier to import arbitrary Python files in a script, without having to add them to the PYTHONPATH first.

Build system pieces:

  • setup_helpers - Helper code for searching for third-party dependencies on the user system.
  • build_pytorch_libs.py - cross-platform script that builds all of the constituent libraries of PyTorch, but not the PyTorch Python extension itself.
  • build_libtorch.py - Script for building libtorch, a standalone C++ library without Python support. This build script is tested in CI.

Developer tools which you might find useful:

Important if you want to run on AMD GPU:

  • amd_build - HIPify scripts, for transpiling CUDA into AMD HIP. Right now, PyTorch and Caffe2 share logic for how to do this transpilation, but have separate entry-points for transpiling either PyTorch or Caffe2 code.
    • build_amd.py - Top-level entry point for HIPifying our codebase.

Tools which are only situationally useful: