Commit Graph

138 Commits

Author SHA1 Message Date
Grzegorz Pawelczak
ec82efd4ce [XLA] Query whether to enable XLA support on MacOS with no as a default 2018-10-09 15:03:46 +01:00
Yifei Feng
ec451f5ab4 Break up build --define <option_name>=true into two steps:
1) define bazel config
   build:<bazel_config_name> --define <option_name>s=true
2) set the config
   build --config=<bazel_config_name>

PiperOrigin-RevId: 215951614
2018-10-05 13:03:15 -07:00
A. Unique TensorFlower
53faa313b7 Switch NCCL to build from open source (version 2.3.5-5) by default.
Note to users manually patching ptxas from a later toolkit version:
Building NCCL requires the same version of ptxas and nvlink.

PiperOrigin-RevId: 215911973
2018-10-05 08:53:12 -07:00
Yifei Feng
ed90461100 Update reference to tools/bazel.rc to .bazelrc after cl/215483141
PiperOrigin-RevId: 215623215
2018-10-03 14:07:00 -07:00
TensorFlower Gardener
bbc9c1f14a Merge pull request #21374 from perfinion:bazel
PiperOrigin-RevId: 215483141
2018-10-02 16:52:00 -07:00
TensorFlower Gardener
ea5c529ed7 Merge pull request #22519 from jayfurmanek:nccl2_configure
PiperOrigin-RevId: 215310536
2018-10-01 17:28:26 -07:00
Ayush Dubey
52574f9527 Remove jemalloc build files and dead configuration options.
PiperOrigin-RevId: 215291195
2018-10-01 15:33:13 -07:00
A. Unique TensorFlower
44acd839c5 Fix reported cuDNN default version during configuration.
PiperOrigin-RevId: 215272308
2018-10-01 13:49:24 -07:00
TensorFlower Gardener
61a872068e Merge pull request #22210 from dmitrievanthony:apache-ignite-dataset
PiperOrigin-RevId: 215258743
2018-10-01 12:25:39 -07:00
A. Unique TensorFlower
7c5eb354a6 In TensorFlow configure, write the .tf_configure.bazelrc into the --workspace path if provided.
This allows repositories that depend on TensorFlow to execute
'bazel run @org_tensorflow//:configure -- --workspace $(pwd)'
to configure TensorFlow.
END_PUBLIC

Before this change, the .tf_configure.bazelrc ended up in the bazel exec root, and 'bazel clean' would undo the configuration.

PiperOrigin-RevId: 215209207
2018-10-01 07:20:21 -07:00
Gunhan Gulsoy
47503fdbfa Disable jemalloc, and remove its configuration option.
PiperOrigin-RevId: 215020524
2018-09-28 17:21:20 -07:00
Todd Wang
35459cbaa0 Build TF with XLA support by default.
Building binaries with XLA support does not enable it by default, it
simply makes it accessible via default binary builds.

PiperOrigin-RevId: 214942824
2018-09-28 09:00:05 -07:00
Jason Zaman
d3f6b72bc7 configure: use workspace-relative path to tf_configure_bazelrc
/.bazelrc is not gitignored anymore so this should help in case the
import line is accidentally committed. Bazel 0.18.0 will support a new
'try-import' statement that should be used once 0.18.0 has been out long
enough.

Signed-off-by: Jason Zaman <jason@perfinion.com>
2018-09-28 23:40:29 +08:00
Gunhan Gulsoy
d56c298f1e Remove AWS, GCP, Kafka and HDFS options from configure. Make them default on
for supported operating systems.

PiperOrigin-RevId: 214886845
2018-09-27 22:02:53 -07:00
avijit-nervana
f172c52ac7 Fixed the broken unit tests 2018-09-27 13:38:04 -07:00
TensorFlower Gardener
62e60166de Merge pull request #20277 from ROCmSoftwarePlatform:upstream-staging
PiperOrigin-RevId: 214793113
2018-09-27 10:22:55 -07:00
A. Unique TensorFlower
77e2686a29 Reduce the size of //tensorflow/tools/pip_package:simple_console_windows
This change reduce the size of //tensorflow/tools/pip_package:simple_console_windows's zip file from 1000027677 bytes to 47690474 bytes for a CPU build. For GPU build, it will avoid going over 4GB when multiple CUDA compatibility are specified.

To fix #22390

PiperOrigin-RevId: 214764423
2018-09-27 06:23:37 -07:00
Gunhan Gulsoy
3da0dff642 Remove verbs, gdr and ngraph questions in configure script.
PiperOrigin-RevId: 214643700
2018-09-26 12:00:41 -07:00
jayfurmanek
49978a87c8
Merge branch 'master' into nccl2_configure 2018-09-26 07:41:29 -05:00
Gunhan Gulsoy
ffa90fc521 Fixes for building with CUDA on ppc64le.
PiperOrigin-RevId: 214569615
2018-09-26 01:43:15 -07:00
Jason Furmanek
1668d28ca3 fix in last line of set_system_lib_flag 2018-09-26 05:22:04 +00:00
Jason Furmanek
d596784484 fix unintential removal of set_system_libs_flag 2018-09-26 05:19:10 +00:00
Jason Furmanek
7c2341501a Find NCCL2 debians in Tensorflow configure 2018-09-26 04:44:12 +00:00
Jason Zaman
5fc39bd5d6 configure.py: enhance systemlibs config
Allow TF_SYSTEM_LIBS env var to split on spaces or commas.
Write PREFIX and related variables to bazelrc as well.

Signed-off-by: Jason Zaman <jason@perfinion.com>
2018-09-22 10:31:27 +08:00
Anna R
a9a1d5a673 Add --config=v2 option to the .bazelrc file.
PiperOrigin-RevId: 213027176
2018-09-14 12:50:07 -07:00
hellcom
9a13fc3595 Fix missprint - unknown variable name.
Signed-off-by: hellcom <vitalii.stoianov.ua@gmail.com>
2018-09-12 10:58:24 +03:00
Anton Dmitriev
8530167f68 Add IgniteDataset that allows to work with Apache Ignite. 2018-09-11 10:01:10 +00:00
Wen-Heng (Jack) Chung
69d3b8faf4 [ROCm] bazel build system and continuous integration logic
The commit contains following components to support TensorFlow on ROCm platform

- bazel build system
- continuous integration logic

Authors:

- Jack Chung: jack.chung@amd.com
- Jeffrey Poznanovic: Jeffrey.Poznanovic@amd.com
- Peng Sun: Peng.Sun@amd.com
2018-09-05 23:50:51 +00:00
Ilya Biryukov
1c3d02eb35 Use LLD when building with downloaded GPU toolchain
This improves build times when using the downloaded clang toolchain.

Additionally, remove '-B/usr/bin' flags from the cuda CROSSTOOL when using
the downloaded toolchain.
It was forcing 'clang' to first search for the linker in '/usr/bin',
preventing downloaded LLD from being selected.

PiperOrigin-RevId: 211430374
2018-09-04 03:15:01 -07:00
A. Unique TensorFlower
d340f4700e Add NDK r16 to Bazel's supported range of NDKs.
PiperOrigin-RevId: 210975274
2018-08-30 14:12:39 -07:00
TensorFlower Gardener
c72c36145b Merge pull request #21122 from NervanaSystems:master
PiperOrigin-RevId: 209623532
2018-08-21 11:02:41 -07:00
Yifei Feng
5198cb8b3d PR #21373: nsync dep updates
Please approve this CL. It will be submitted automatically, and its GitHub pull request will be marked as merged.

Imported from GitHub PR #21373

A new version of nsync is released, this updates the workspace.bzl and adds nsync to the libs that can be unbundled. I've packaged nsync on Gentoo Linux and tested the full unbundled build.

The CMake build is also updated to the latest version, the patch is no longer required and is removed. I have tested the cmake build on my machine but the CI needs to test windows since I can't.

The last commits update ./configure to handle adding TF_SYSTEM_LIBS and an option to disable stripping.

@m3bm3b, can you review too?

Copybara import of the project:

  - 3d224b29fcf699b84cf538e2d16e3dd4e78e6a91 workspace: update nsync dep to 1.20.1 by Jason Zaman <jason@perfinion.com>
  - 34536b88bedc5a83ad939438a49a3cc53aea210c CMake: nsync: update to 1.20.1 by Jason Zaman <jason@perfinion.com>
  - f2444ba218ae280e03710f936b249b6b650ea3dd third_party: unbundle nsync by Jason Zaman <jason@perfinion.com>
  - 4386d8c4b01020ba1c979258e5102ac1947d2574 configure: Add TF_SYSTEM_LIBS handling by Jason Zaman <jason@perfinion.com>
  - f3fd1f110781cfb8cc941241a69eb41114787bfd Merge 4386d8c4b01020ba1c979258e5102ac1947d2574 into a05c7... by Jason Zaman <jasonzaman@gmail.com>

COPYBARA_INTEGRATE_REVIEW=https://github.com/tensorflow/tensorflow/pull/21373 from perfinion:nsync 4386d8c4b01020ba1c979258e5102ac1947d2574
PiperOrigin-RevId: 209201545
2018-08-17 13:57:13 -07:00
Avijit
bc6be507c7 Merge remote-tracking branch 'upstream/master' 2018-08-15 17:00:22 -07:00
Sami Kama
603b4b66b0
Remove set_build_strip_flag 2018-08-14 18:01:33 -07:00
Sami Kama
4e368d7143
Merge branch 'master' into BazelNoStrip 2018-08-14 15:00:46 -07:00
Niall Moran
b7d97e85a5 Update cuda and cudnn paths to for debian 2018-08-09 00:29:49 +01:00
Avijit
1cdacb8b10 Merge remote-tracking branch 'upstream/master' 2018-07-25 01:08:01 -07:00
Avijit
f88a6f93be Updated the ngraph_tf hash and PEP8 for configure.py 2018-07-24 23:58:58 -07:00
Avijit
121e0161c5
nGraph integration with TensorFlow
* Added nGraph bridge as a third_party to be built with TensorFlow based on user selection.
* Added a limited set of C++ unit tests to verify the correctness of the computation
2018-07-24 23:35:27 -07:00
Yifei Feng
bb384118db Upgrade bazel to 0.15.0.
PiperOrigin-RevId: 205878953
2018-07-24 13:16:04 -07:00
A. Unique TensorFlower
8ed40cdd3e Fix grammar in configure.py
PiperOrigin-RevId: 205421605
2018-07-20 10:59:46 -07:00
Reed Wanderman-Milne
716d15118f Update minimum bazel version to 0.13.0.
I was using bazel 0.12.0 and was getting the error:

file '@bazel_tools//tools/cpp:windows_cc_configure.bzl' does not contain symbol 'setup_vc_env_vars'

PiperOrigin-RevId: 205316270
2018-07-19 15:55:52 -07:00
A. Unique TensorFlower
1b21235444 Improve Windows build process
After this change, the windows build steps should be like:
https://docs.google.com/document/d/1oVYzPJVv8r5N9PecqwG74rY_QbqPH70IxBouBHdq5EI/edit?usp=sharing

PiperOrigin-RevId: 205295588
2018-07-19 13:52:06 -07:00
Yifei Feng
11020427c9 Automated rollback of commit 5e7178ddb7
PiperOrigin-RevId: 205165137
2018-07-18 17:32:02 -07:00
Yifei Feng
5e7178ddb7 Upgrade bazel to 0.15.0.
PiperOrigin-RevId: 205147588
2018-07-18 15:36:03 -07:00
Shashi Shekhar
c0ff0cccd4 Fix default SDK path for Mac.
PiperOrigin-RevId: 204919096
2018-07-17 09:03:39 -07:00
TensorFlower Gardener
a013474eae Merge pull request #20357 from JonTriebenbach:openblas-for-ppc64le
PiperOrigin-RevId: 204859562
2018-07-16 22:23:31 -07:00
Toby Boyd
e4c0dbcab8 internal change
PiperOrigin-RevId: 204832902
2018-07-16 17:10:20 -07:00
A. Unique TensorFlower
6e97fb388a Disable more TF_NEED_* on Windows by default.
This simplifies ./configure process on Windows, we can remove them when we actually support the corresponding feature on Windows.

PiperOrigin-RevId: 204804112
2018-07-16 14:10:38 -07:00
Smit Hinsu
fe7d1d9447 Update default cuda compute capability while installing from sources to cover up to Volta
PiperOrigin-RevId: 204606836
2018-07-14 13:20:25 -07:00