Commit Graph

310 Commits

Author SHA1 Message Date
Reed Wanderman-Milne
2d45d27274 In configure.py, print info on --config=v1 instead of --config=v2.
Explicitly listing --config=v2 incorrectly implied that building for TF2 was not the default.

PiperOrigin-RevId: 381038392
Change-Id: I6400a8edf40a7941d3b5132388d44f7aae698ea5
2021-06-23 08:43:36 -07:00
TensorFlower Gardener
0fc369b1b9 Merge pull request #50297 from ROCmSoftwarePlatform:google_upstream_rocsolver_wrapper
PiperOrigin-RevId: 380234650
Change-Id: I710f59a0a70a7bfb0b775bc8fee54205479a42dd
2021-06-18 12:03:58 -07:00
Deven Desai
1a128d898a set ROCBLAS_TENSILE_LIBPATH when building with --config=rocm
With the integration of rocsolver in the XLA cusolver pass, we need to set the ROCBLAS_TENSILE_LIBPATH env var. This seems to be required by rocsolver (which presumably calls rocblas internally). Not doing so leads to the following error in some of the XLA unit tests

```
test : //tensorflow/compiler/tests:dense_layer_test_gpu                         FAILED in 3 out of 3 in 4.7s

rocBLAS warning: No paths matched /root/.cache/bazel/_bazel_root/efb88f6336d9c4a18216fb94287b8d97/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/compiler/tests/dense_layer_test_gpu.runfiles/org_tensorflow/tensorflow/python/../../_solib_local/_U@local_Uconfig_Urocm_S_Srocm_Crocblas___Uexternal_Slocal_Uconfig_Urocm_Srocm_Srocm_Slib/library/*gfx900*co. Make sure that ROCBLAS_TENSILE_LIBPATH is set correctly.

rocBLAS error: Cannot read /root/.cache/bazel/_bazel_root/efb88f6336d9c4a18216fb94287b8d97/execroot/org_tensorflow/bazel-out/k8-opt/bin/tensorflow/compiler/tests/dense_layer_test_gpu.runfiles/org_tensorflow/tensorflow/python/../../_solib_local/_U@local_Uconfig_Urocm_S_Srocm_Crocblas___Uexternal_Slocal_Uconfig_Urocm_Srocm_Srocm_Slib/library/TensileLibrary.dat: No such file or directory

```
2021-06-16 16:44:24 +00:00
TensorFlower Gardener
ce227000bd Merge pull request #48522 from yongtang:no-aws-hdfs
PiperOrigin-RevId: 371807950
Change-Id: Id7e762945f0b5d965865220d213cb297bb565f3e
2021-05-03 17:03:56 -07:00
Yong Tang
12a9cb07c1 Remove AWS/HDFS related options and licenses
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
2021-04-27 13:41:28 +00:00
YoungSeok Yoon
1a0b21e16b Update NDK version to r19c
PiperOrigin-RevId: 367340749
Change-Id: I770ad6efc9b7a4ec822ba7cafd36d73e31daaf8e
2021-04-07 18:54:45 -07:00
TensorFlower Gardener
9e26f3b56a Merge pull request #47775 from alenik01:aarch64_build_patch
PiperOrigin-RevId: 365049267
Change-Id: I839a9fb319ccc347b50defeaabb1c3f1ec3cfb5c
2021-03-25 09:03:00 -07:00
Aleksandr Nikolaev
1e15aa8c83
Merge branch 'master' into aarch64_build_patch 2021-03-19 19:45:25 +00:00
Christian Sigg
dd372ec5e1 Do not write TF_CONFIGURE_IOS to .bazelrc, only use it in ./configure.py.
PiperOrigin-RevId: 363484115
Change-Id: I5fd6186f19d1612ef9fe85a088aa7a72dc45d26d
2021-03-17 12:48:52 -07:00
Christian Sigg
3c58f664ee Enable XLA by default except on Android/iOS.
Previously, XLA was enabled by default with --config=rbe_linux and when running ./configure.

PiperOrigin-RevId: 363433913
Change-Id: I9afa53496a9da2ae29b71a9ef38fc63b90dfba02
2021-03-17 09:20:15 -07:00
Christian Sigg
2683829da9 Remove no longer needed CUDA 11.0 build configs from .bazelrc.
Use --config=avx_{linux,windows} instead of --config=opt in release builds. This is an NFC because release build scripts set build:opt to enable AVX.

PiperOrigin-RevId: 363193986
Change-Id: Ifb0788e29485873e35469d0936c1d33488315870
2021-03-16 09:03:56 -07:00
Aleksandr Nikolaev
06dd30ef98 Update of --config=mkl_aarch64 with Compute Library support
This PR introduces the support of Compute Library for the Arm
Architecture (ACL) as part of Bazel build.

Signed-off-by: Aleksandr Nikolaev <aleksandr.nikolaev@arm.com>
2021-03-12 19:29:51 -05:00
Christian Sigg
6236b83d80 Switch mlir-generated kernel trigger to starlark-defined flag.
Remove TF_ENABLE_MLIR_GENERATED_GPU_KERNELS env trigger in ./configure for ROCm path. It has already been removed for CUDA, and ROCm currently doesn't yet support kernel gen.

PiperOrigin-RevId: 361635637
Change-Id: Id30c7c45a7fe033410457db9c9b8d51e573482b6
2021-03-08 13:12:16 -08:00
Reed Wanderman-Milne
03bd8a34ed Make default PYTHON_LIB_PATH deterministic.
Before, the default PYTHON_LIB_PATH chosen was non-deterministically. This meant if ./configure was rerun and a different PYTHON_LIB_PATH was chosen, bazel would rebuild TF from scratch.

PiperOrigin-RevId: 356731041
Change-Id: Iefdebd0f6bb106a598f77e95cd36df87bb1c5d68
2021-02-10 07:46:50 -08:00
Austin Anderson
b1f946aed5 Shorten find_cuda_config finder
PiperOrigin-RevId: 353905388
Change-Id: Iaeed674c38bc9346d26e4701f413163212217c37
2021-01-26 11:25:32 -08:00
TensorFlower Gardener
f2e78b8b8a Merge pull request #46075 from machineko:master
PiperOrigin-RevId: 353762309
Change-Id: I49f619f914610a14fd189a0ca169f3cb728f118a
2021-01-25 17:11:17 -08:00
Mihai Maruseac
83ba6a37b2 Updating TensorFlow's bazel version 4.0.0 (the first LTS release).
https://blog.bazel.build/2021/01/19/bazel-4-0.html

PiperOrigin-RevId: 353139694
Change-Id: If2c4516b5d7fa59d032e9c74fb2a0716b2a4f618
2021-01-21 17:37:25 -08:00
Christian Sigg
0b47d35322 Updating TensorFlow's bazel version 4.0.0 (the first LTS release).
https://blog.bazel.build/2021/01/19/bazel-4-0.html

PiperOrigin-RevId: 353029642
Change-Id: I0a8650767f3a69428dcd37badf9a1b1c128d8baf
2021-01-21 09:15:40 -08:00
A. Unique TensorFlower
7e67fdc00c Pass cc_opt_flags to host_copt.
For GPU builds, the host compiler should get these compile flags as well.

PiperOrigin-RevId: 351470659
Change-Id: I8610ac871e370895f9234e3f047e7ee90557db86
2021-01-12 16:26:22 -08:00
Mihai Maruseac
e0a6a8c7e2 No longer compile with -march=native.
Should resolve issue reported in #45744, #45866, #44701 and #45991 as well as multiple other issues from other ecosystem places.

We will patch 2.4 soon and release proper patches.

PiperOrigin-RevId: 350243794
Change-Id: I0aa814dedb44ac3ec992a0a432f117122337023f
2021-01-05 16:37:24 -08:00
machineko
7eb0c7d051 fix path on windows and add better error message for not founding find_cuda_config in working direcotry 2021-01-03 17:14:28 +01:00
machineko
ba3d206884 fix static path for find_cuda_config.py script 2020-12-30 15:28:51 +01:00
Mihai Maruseac
3e9fccb0cb Bump TF's minimum Bazel version to 3.7.2.
Bug fixed: https://github.com/bazelbuild/bazel/issues/3828

We need this because we are working on integrating TF with a different project that should remove the breakages caused by LLVM integration

PiperOrigin-RevId: 348886284
Change-Id: Iad539321f1ba7590e4ee77b93d67eb5401d9fec8
2020-12-23 21:33:56 -08:00
TensorFlower Gardener
5b77c61531 Merge pull request #45456 from ROCmSoftwarePlatform:google_upstream_rocm_remove_rocm_root
PiperOrigin-RevId: 348623263
Change-Id: I62a0648c15584864cbd045a530972ec3158aec9c
2020-12-22 06:19:25 -08:00
Deven Desai
5ef3760234 Removing --action_env=ROCM_ROOT... when building with --config=rocm
When we switched to ROCm 3.3 (first ROCm release with "relocatable ROCm install" support), some parts of the ROCm toolchain relied upon the value of env var ROCM_ROOT to determine the location of the ROCm install dir. This has been fixed, and all of the ROCM toolchain now only uses the ROCM_PATH value.

This commit updates `configure.py` to no longer set ROCM_ROOT, when building with --config=rocm

Related JIRA ticket - http://ontrack-internal.amd.com/browse/SWDEV-226744
2020-12-07 17:44:46 +00:00
YoungSeok Yoon
5a063c275e Migrate TFLite iOS directories out of experimental
PiperOrigin-RevId: 343958075
Change-Id: I4c7736094f1babab288fb57455e29ab4c0c4fa3d
2020-11-23 17:19:01 -08:00
Austin Anderson
9983bb3dee Enable /d2ReducedOptimizeHugeFunctions on Windows by default
This flag was first made available in Visual Studio 16.4, (as of 2020-11-11,
VS is at version 16.8), and can now be considered generally available.

See also #38254

PiperOrigin-RevId: 342158585
Change-Id: Ice96be9a1392313357b314407262a005a2436a4d
2020-11-12 16:45:30 -08:00
TensorFlower Gardener
c2081e9c26 Merge pull request #42870 from Intel-tensorflow:remove-ngraph
PiperOrigin-RevId: 338788931
Change-Id: Ib754711835eb01c1ae928dde72e56cd3a45aa4e2
2020-10-23 20:30:08 -07:00
Abhishek Kulkarni
a772f35ae7 Remove nGraph build support
This PR removes now-deprecated direct integration of nGraph in TF. nGraph
integration is still available via the external ngraph-bridge at:
https://github.com/tensorflow/ngraph-bridge/

or via `pip install ngraph-tensorflow-bridge`.

Signed-off-by: Abhishek Kulkarni <abhishek.kulkarni@intel.com>
2020-10-21 16:34:37 -07:00
Alexander Grund
92214e9d2c
Introduce PROTOBUF_INCLUDE_PATH
This avoids having to install all dependencies into the same folder
Default set so existing behavior is not changed
2020-10-19 15:35:43 +02:00
cfRod
1bcd2dadc6 Add oneDNN-aarch64 reference build option
Adds build option and supporting macros for oneDNN-reference builds on Aarch64.
For now, oneDNN will link to GCC's libgomp.so. See, related issue: https://github.com/tensorflow/tensorflow/issues/42858

Signed-off-by: cfRod <crefeda.rodrigues@arm.com>
2020-10-08 17:23:11 +01:00
Sanjoy Das
3cbb507689 Delete SYCL support
See discussion here:
https://github.com/tensorflow/tensorflow/issues/41809#issuecomment-688021592

Fixes #41809.

PiperOrigin-RevId: 331808169
Change-Id: Ib0861cf250c92c20f0e8a22adce89a4dc4d3548a
2020-09-15 11:21:47 -07:00
TensorFlower Gardener
15bb15f7ca Merge pull request #41515 from ROCmSoftwarePlatform:google-upstream-rocm-mlir-integration-prototype
PiperOrigin-RevId: 329868219
Change-Id: I09132dcdaca4653924d7003b878eaca9f1f9971a
2020-09-03 00:43:12 -07:00
Deven Desai
4c0b4a8124 Update configure.py to provide a way to enable MLIR generated gpu kernels on the ROCm platform.
MLIR generated gpu kernels will continue to be disabled by default.

This commit provides a way to enable them, if conifugre.py is run with the env `TF_ENABLE_MLIR_GENERATED_GPU_KERNELS=1`
2020-08-26 13:50:01 +00:00
hedgehog91
668eaa2b12
change_exit_code_when_bazel_none 2020-06-24 21:36:46 +03:00
Jakob Buchgraber
d2b02580e6 Update TF bazel version requirements.
PiperOrigin-RevId: 315483879
Change-Id: I4be29ffa3c425f01c28dc8c95250209a2b0bada4
2020-06-09 08:04:07 -07:00
Amit Patankar
639d9373d3 Fix a typo in configure.
PiperOrigin-RevId: 313914447
Change-Id: Id55394dd29a51e96e448117c7435f057fe7b92ba
2020-05-30 01:13:30 -07:00
Amit Patankar
a5393e9046 Support the new CUDA compute capability options in configure.
sm_35,sm_50,sm_60,compute_70

PiperOrigin-RevId: 313660333
Change-Id: I08b6ccd62fac60645147c30c434055b4e608b190
2020-05-28 14:36:24 -07:00
George Karpenkov
07898e752c Provide a more informative error message when the bazel version check fails
Currently, if the version check fails, the error message is:

```
subprocess.CalledProcessError: Command '['bazel', '--batch', '--bazelrc=/dev/null', 'version']' returned non-zero exit status 1.
```

After this patch, it becomes:

```
Error checking bazel version:  ERROR: The project you're trying to build requires Bazel 3.0.0 (specified in /usr/local/google/home/cheshire/code/opensource/docker_tf/tensorflow/.bazelversion), but it wasn't found in /usr/bin.

You can install the required Bazel version via apt:
  sudo apt update && sudo apt install bazel-3.0.0
```

PiperOrigin-RevId: 312520687
Change-Id: I41523f7defa3db10aa34b6b313d6b65c792b2020
2020-05-20 11:31:08 -07:00
Jared Duke
1f530076d1 Fix TFLite builds on Windows/MacOS
Avoid using `--enable_platform_specific_config` when cross-compiling for
iOS/Android, as this pulls in host build flags, which may not be
appropriate (e.g., when cross-compiling for Android on a Windows host).

Also fix an issue when building tensorflowlite_c for iOS.

Fixes #38525.

PiperOrigin-RevId: 311767770
Change-Id: I80b817fd89a6889dc78be50f1def8b899f091cb6
2020-05-15 11:26:35 -07:00
TensorFlower Gardener
9784cf282e Merge pull request #39399 from marload:patch-0511-01
PiperOrigin-RevId: 311208506
Change-Id: Ic4d22e1b01554cfe7eaab759ecbc0c2cadc3c002
2020-05-12 15:05:26 -07:00
marload
c6d2369174 Refactoring: Format String -> Format Method 2020-05-11 15:37:57 +09:00
A. Unique TensorFlower
56a99d6c28 configure.py: Simplify bazel version check
Use `bazel --version` instead of `bazel --batch version`.

`bazel --batch` fails on Windows with a "command line too long" error, if user's environment variable is too large.
Example: https://buildkite.com/bazel/bazelisk-plus-incompatible-flags/builds/496#f5fbd8db-7421-43f4-a018-555af9856be4

`bazel --version` can also print the Bazel version without starting Bazel server, it's even faster than `bazel --batch version`.

PiperOrigin-RevId: 310570885
Change-Id: Iafc4c90f0ff57610e5f77bee230e81e78d9f1289
2020-05-08 09:31:43 -07:00
TensorFlower Gardener
05fdea64d1 Merge pull request #38654 from ROCmSoftwarePlatform:google_upstream_rocm_switch_to_rocm33
PiperOrigin-RevId: 308160300
Change-Id: Icd6e71c7bbfe22e0386ff7ebfdc926cf20b3b420
2020-04-23 17:12:38 -07:00
Deven Desai
f0bf514df3 [ROCm] Updating Dockerfile.rocm / CI scripts to use ROCm 3.3 2020-04-20 14:51:13 +00:00
Gunhan Gulsoy
2f65c2468d Update TF bazel version requirements.
PiperOrigin-RevId: 306572687
Change-Id: I49448295cdd088eb114a7d518dd0db1822f2d7a6
2020-04-14 21:11:14 -07:00
Taehee Jeong
3b792decf2 Rename Core ML delegate's BUILD.apple to BUILD
PiperOrigin-RevId: 306165129
Change-Id: Ife85058c65ef5452c3d97f7fc1b7f0670b624474
2020-04-12 19:27:02 -07:00
Taehee Jeong
0666305b11 Opensource Core ML delegate
protobuf version is upgraded to 3.9.2

PiperOrigin-RevId: 304317221
Change-Id: I1e70080753fa6df588885eeea1cc84dcd8557097
2020-04-01 20:34:33 -07:00
TensorFlower Gardener
2fa7369fe9 Merge pull request #36673 from wdirons:fix_gpu_test_in_configure
PiperOrigin-RevId: 302039094
Change-Id: Ie5980e0a8feda85bd6803bd316e5a59793891515
2020-03-20 09:28:07 -07:00
Gunhan Gulsoy
e733b05fc5 Fix the XLA disabling mechanism in configure.py
Environment variables are strings, not integers.'0' does not evaluate to false.

PiperOrigin-RevId: 297916971
Change-Id: I9df143690b16a181fa5f0c4a60ac2f944b396672
2020-02-28 13:30:38 -08:00