Commit Graph

24 Commits

Author SHA1 Message Date
Vladimir Belitskiy
fa3b3c1a0d Update scripts/configs for Windows nightly/release builds.
`set -u` (does not allow unbound variables) has been removed from all scripts.
This is due to Docker on Windows treating variables in an env file,
set to an empty value (`MY_VAR=`), as unbound variables. Consequently,
these variables, even though they are "set", do not make it into the Docker
container at all, and various checks for those variables fail outright.

PiperOrigin-RevId: 713717958
2025-01-09 10:37:25 -08:00
A. Unique TensorFlower
49d80051ec Replace manyLinux compliance check action in TF wheel build rule with macros for Linux platforms.
Example of usage:

```
load(
    "@tsl//:third_party/py/py_manylinux_compliance_test.bzl",
    "verify_manylinux_compliance_test",
)

verify_manylinux_compliance_test(
    name = "manylinux_compliance_test",
    aarch64_compliance_tag = "manylinux_2_17_aarch64",
    test_tags = [
        "mac_excluded",
        "windows_excluded",
    ],
    wheel = ":wheel",
    x86_64_compliance_tag = "manylinux_2_17_x86_64",
)
```

The test target is executed only when specified in Bazel command line. The test passes if `auditwheel show` results have the compliance tag value (depends on the machine type). The test fails otherwise and prints the `auditwheel show` results.

PiperOrigin-RevId: 708024471
2024-12-19 14:17:53 -08:00
Vladimir Belitskiy
dc24ff7fcb Specify a much shorter output path for Bazel on Windows.
To avoid running into the 259 character path length limitation.

PiperOrigin-RevId: 698786300
2024-11-21 08:24:19 -08:00
A. Unique TensorFlower
2b6976dd8a Refactor TF wheel build rule, common python rules and flag names.
For Linux platforms the build rule generates the `auditwheel show` log in the output regardless of compliance check flag.

PiperOrigin-RevId: 698048983
2024-11-19 09:55:09 -08:00
A. Unique TensorFlower
5667b2dfa8 Add TF wheel compliance verification in Bazel build rule.
The compliance check is disabled by default, but can be turned on by `--@local_tsl//third_party/py:wheel_compliance=true` option.

PiperOrigin-RevId: 695870736
2024-11-12 14:33:28 -08:00
A. Unique TensorFlower
14fe7ddb7d Add TF wheel API Bazel test for Linux and MacOS platforms.
PiperOrigin-RevId: 689025141
2024-10-23 11:48:35 -07:00
A. Unique TensorFlower
16692e241e Add building TF wheel to Linux and MacOS presubmit jobs.
Refactor shell scripts: replace `TF_PYTHON_VERSION` with `HERMETIC_PYTHON_VERSION`.

PiperOrigin-RevId: 685867155
2024-10-14 16:45:36 -07:00
Kanglan Tang
cbb605fed1 Update TF CI scripts for NumPy 1
PiperOrigin-RevId: 681565583
2024-10-02 14:18:17 -07:00
Vladimir Belitskiy
7f03e159cd Set up a new Windows presubmit, and have it use the pycpp.sh script.
PiperOrigin-RevId: 660554802
2024-08-07 16:01:25 -07:00
A. Unique TensorFlower
87a10faa4d Minor fix for addressing TF query analysis errors
PiperOrigin-RevId: 604669820
2024-02-06 09:29:44 -08:00
Nitin Srinivasan
960ced3b2e Add experimental build-only Linux Arm64 continuous job
This is an experimental job that only builds the tests and does not run them. The ML DevInfra team is using this to collect data on how these builds perform in production when compared to the regular continuous job (build + test) and to see if their runtime is fast enough to be enabled as presubmit (~20-25 mins)

"pycpp.sh" is modified such that it can be used either in build or test mode. Set `TFCI_PYCPP_SWAP_TO_BUILD_ENABLE` to 1 to enable build mode (default is test mode). Since test configs inherit from build, `linux_arm64_pycpp_test` and `linux_arm64_pycpp_test_filters` are changed to be prefixed with "build:" so that we can run both `bazel build` and `bazel test` commands with the same config.

PiperOrigin-RevId: 603543484
2024-02-01 18:54:25 -08:00
A. Unique TensorFlower
4f5b948a7a Addressing TF query analysis errors
PiperOrigin-RevId: 602866660
2024-01-30 16:10:46 -08:00
Austin Anderson
ad4501c116 More progress on docs 2024-01-10 11:39:41 -08:00
Austin Anderson
4aa4f8261f Shrink wheel-verification, share TFCI_ vars to Docker, remove arrays, fix vars
PiperOrigin-RevId: 579915165
2023-11-06 12:03:27 -08:00
Austin Anderson
7cf4309dea Add bisect & any scripts, allow Docker rebuilds, integrate bazelrcs
Documentation for these will come soon.

PiperOrigin-RevId: 568558257
2023-09-26 09:18:55 -07:00
Austin Anderson
11893a88d5 Remove shell variables from bazelrcs
I forgot that Bazel does not expand shell variables inside of bazelrc files.

I also removed the extraneous printing of the index.html file into the log,
since it's not really helpful there.

PiperOrigin-RevId: 556978923
2023-08-14 19:02:22 -07:00
Austin Anderson
5bb3a7fd91 Convert "build/" dir to "build_output" dir and make it configurable
I originally used "build/" as the canonical output directory for all build
scripts, but that collided with a "BUILD" file in the TF root directory on
Windows. That was too confusing to handle, so I added a TFCI_OUTPUT_DIR
variable and set it to default to build_output instead, both of which are
additionally easier to search for. Just "build" is overloaded.

PiperOrigin-RevId: 556858432
2023-08-14 11:37:33 -07:00
TensorFlower Gardener
c35b2d5724 Merge pull request #61206 from angerson:master
PiperOrigin-RevId: 547573465
2023-07-12 12:47:53 -07:00
Austin Anderson
9c57db4e22 Handle feedback 2023-07-07 17:31:00 -07:00
Austin Anderson
5a85a6859d Cleanup 2023-07-06 18:37:42 -07:00
Austin Anderson
211d99d483 Dedup setup 2023-07-06 17:57:28 -07:00
Austin Anderson
97f57ad350 Fix confusing equality checks and some other stuff 2023-06-29 12:35:27 -07:00
Austin Anderson
adbcd77908 Update cleaner scripts 2023-06-28 23:12:57 -07:00
Austin Anderson
213c1439b9 Before trying big redo 2023-06-28 17:18:30 -07:00