Commit Graph

98737 Commits

Author SHA1 Message Date
Vijay Vasudevan
2d1163582a TensorFlow: upstream changes from Eigen to make build work
with nvcc in debug mode.
2015-12-08 15:41:27 -08:00
Vijay Vasudevan
2c3738db9c TensorFlow: Upstream changes to git.
Change 109730179
	Add support for selecting partition strategy in tf.nn.embedding_lookup and related ops, and allow unequally-sized shards to be used as input.
Change 109729548
	TensorFlow: add RELEASE.md notes for 0.6.0.
Change 109728185
	Make seq2seq_test non-flaky by setting python and numpy random seed.
Change 109725913
	Refactor slot creation in optimizers and moving averages to separate file
Change 109718024
	TensorFlow: reduce runtime of seq2seq_test from ~30s to ~18s.
Change 109712251
	More performance improvement for convnet on GPU.
	+ Switch forward convolution format to NCHW.
	+ Allocate scratch space for forward- and backward- convolutions.
	+ Users can use "TF_CUDNN_WORKSPACE_LIMIT_IN_MB" to configure the scratch space
	limit. The default limit in 1GB.
Change 109710898
	Added extract_sub_graph utility function

Base CL: 109731609
2015-12-08 14:55:13 -08:00
Vijay Vasudevan
4c717c6ac3 Merge commits from internal. 2015-12-08 10:30:44 -08:00
Vijay Vasudevan
ddd4aaf528 TensorFlow: upstream changes to git.
Change 109695551
	Update FAQ
Change 109694725
	Add a gradient for resize_bilinear op.
Change 109694505
	Don't mention variables module in docs

	variables.Variable should be tf.Variable.
Change 109658848
	Adding an option to create a new thread-pool for each session.
Change 109640570

	Take the snapshot of stream-executor.
	+ Expose an interface for scratch space allocation in the interface.

Change 109638559
	Let image_summary accept uint8 input

	This allows users to do their own normalization / scaling if the default
	(very weird) behavior of image_summary is undesired.

	This required a slight tweak to fake_input.cc to make polymorphically typed
	fake inputs infer if their type attr is not set but has a default.

	Unfortunately, adding a second valid type to image_summary *disables* automatic
	implicit conversion from np.float64 to tf.float32, so this change is slightly
	backwards incompatible.
Change 109636969
	Add serialization operations for SparseTensor.
Change 109636644
	Update generated Op docs.
Change 109634899
	TensorFlow: add a markdown file for producing release notes for our
	releases.  Seed with 0.5.0 with a boring but accurate description.
Change 109634502
	Let histogram_summary take any realnumbertype

	It used to take only floats, not it understands ints.
Change 109634434
	TensorFlow: update locations where we mention python 3 support, update
	them to current truth.
Change 109632108
	Move HSV <> RGB conversions, grayscale conversions, and adjust_* ops back to tensorflow
	- make GPU-capable version of RGBToHSV and HSVToRGB, allows only float input/output
	- change docs to reflect new size constraints
	- change HSV format to be [0,1] for all components
	- add automatic dtype conversion for all adjust_* and grayscale conversion ops
	- fix up docs
Change 109631077
	Improve optimizer exceptions

	1. grads_and_vars is now a tuple, so must be wrapped when passed to format.
	2. Use '%r' instead of '%s' for dtype formatting

Base CL: 109697989
2015-12-08 09:58:59 -08:00
Illia Polosukhin
bd443b5236 Merge pull request #24 from terrytangyuan/patch-1
Added missing CV import in multiple_gpu example
2015-12-08 08:50:55 -08:00
Yuan (Terry) Tang
08ce346c57 Added missing CV import in multiple_gpu example 2015-12-08 07:51:10 -06:00
Jeff Hammerbacher
095f1988a0 Change log directory in text to match code in TensorBoard How To
Change-Id: Idf0135aeecf7b66d57633991d36b1edee22bbf4e
2015-12-08 07:26:12 -05:00
Illia Polosukhin
e35c3adde3 Merge branch 'terrytangyuan-travis' 2015-12-08 00:06:56 -08:00
Illia Polosukhin
27a4e9d5d6 Added custom regex for unused variables (usused_*) 2015-12-08 00:06:04 -08:00
Illia Polosukhin
fb8f783c60 Fixed split_squeeze and expand_concat 2015-12-08 00:01:09 -08:00
Illia Polosukhin
7f258621e0 removed accidental file 2015-12-08 00:00:50 -08:00
Illia Polosukhin
57d328be3e remove accidental .swp 2015-12-07 23:49:03 -08:00
Illia Polosukhin
1d7430c276 Added pylint.rc with disabled number of non-representative (at this point) warnings 2015-12-07 23:47:24 -08:00
Illia Polosukhin
cbfc6804a5 Major styleguide shakeup to satisfy pylint 2015-12-07 23:46:32 -08:00
Illia Polosukhin
46f83bd6bb Merge branch 'travis' of https://github.com/terrytangyuan/skflow into terrytangyuan-travis 2015-12-07 22:54:54 -08:00
Illia Polosukhin
c69b3c78a0 Merge branch 'master' of github.com:google/skflow 2015-12-07 22:54:20 -08:00
Illia Polosukhin
cff8e6e57e Merge branch 'terrytangyuan-multGPU' 2015-12-07 22:52:38 -08:00
Illia Polosukhin
30cb4ca6c1 Merge branch 'multGPU' of https://github.com/terrytangyuan/skflow into terrytangyuan-multGPU 2015-12-07 22:52:17 -08:00
Illia Polosukhin
64bfe1b355 Merge pull request #18 from terrytangyuan/patch-2
ENH: Setup the summary writer for later optional visualization
2015-12-07 22:48:49 -08:00
Illia Polosukhin
43cd5c0131 Fixes #22: Added cross_validation to iris.py and iris_custom_model.py 2015-12-07 22:46:14 -08:00
Illia Polosukhin
9b17502aaa Captured graph into a variable in TFEstimator and added handling for small number of steps in TFTrainer 2015-12-07 22:44:07 -08:00
Jim Fleming
f32659b041 Change "can" to "must" to avoid ambiguity in required arguments
Change-Id: Icc43cfc9950c7acae145a37af8eb83282dada455
2015-12-08 06:17:10 +00:00
Vijay Vasudevan
a5d8217c4e Merge from internal. 2015-12-07 16:03:53 -08:00
Vijay Vasudevan
cd53f3c330 TensorFlow: upstrea changes from git.
Change 109628097
	Fix gcc 4.8.1 compile

	Modified from patch by @assolini here:

	https://github.com/tensorflow/tensorflow/issues/405
Change 109624275
	Make preview frame ImageReader global so that it does not get GC'd.

	This may fix an issue with connecting to the camera on some devices where the underlying Surface is prematurely cleaned up (http://stackoverflow.com/questions/33437961/android-camera-2-api-bufferqueue-has-been-abandoned).
Change 109620599
	- improved test a little to make it easier to understand as it serves as an
	example for users
Change 109614953
	TensorFlow: update tutorials/howtos to point to correct
	location of files, show python example in addition to bazel.
Change 109612732
	TensorFlow: move reading_data into examples, change data dir
	to /tmp/data.  Validated that they all run, but these
	probably need a selftest at some point.
Change 109608695
	Apply 'gate_gradients' only when there is more than one real gradients.
Change 109605014
	There are 3 obvious places to start using TensorFlow. 2/3 of the starting points do not have a link to the installation instructions.
Change 109604287
	Make the `tf.reshape` shape function more restrictive.

	Previously, it did not raise a construction-time error if the input
	shape and the new shape were incompatible; now it detects this and
	raises a `ValueError`.
Change 109603375
	TensorFlow: Move word2vec_basic.py from g3doc/ to examples/

	There are no additional libraries this uses, so nothing else
	needs to be done
Change 109601289
	TensorBoard tag 3
Change 109600908
	Decrease number of scalar values stored by TensorBoard.
	10k is more than displays nicely.
Change 109599464
	Fix "smart restart" functionality in TensorBoard (it throws away dead data)
	After restarts, a file_version event is created that always has step 0.
	We need to ignore this.
Change 109597667
	Switch to using /dev/urandom for TensorFlow randomness.

	Using /dev/random leads to slowdown when running in an environment
	with poor access to an entropy source (such as some VMs). /dev/urandom
	has more predictable performance, and we don't require
	cryptographically secure random number generation, so a PRNG is good
	enough.

	Also removes the use of the RNG in DirectSession construction. This
	was being used to generate a session handle, which is not necessary
	(since a DirectSession owns its devices, we don't need a unique handle
	to key the OpSegment objects registered with the various devices).

	This addresses bugs that have been reported on the mailing list and
	Stack Overflow.
Change 109596906
	Add an is_unsigned property to dtype
Change 109596830
	Remove unnecessary fill in clip_by_value
Change 109591880
	Remove Android demo's libpthread.so dummy file (required by protobuf) from repo and generate it at compile-time.

	This makes the Android demo more portable, as the generated file will now always be the correct archictecture for linking.
Change 109589028
	Isolating out the RTTI part of TensorFlow and add non-RTTI backups for Android.
	This saves about 400KB of the compiled library, when compiling the Android
	tensorflow target with -fno-rtti.
Change 109589018
	Internal reworking of LSTMCell.
Change 109588229
	Allow bool-valued tensors to be persisted.
Change 109577175
	TensorBoard host defaults to 0.0.0.0
Change 109551438
	TensorFlow: move mnist g3doc tutorials into tensorflow/examples.

	Update examples to point to the correct location.

	Adds tests to make sure they don't regress, do some lint cleanup.

Base CL: 109630240
2015-12-07 15:48:00 -08:00
Jeff Hammerbacher
1feceb6906 Update MNIST tutorial for beginners to indicate that the data is split into 3 rather than 2 parts.
Change-Id: I8f4b4453d07d25964ca756d40e6925b549c5f220
2015-12-07 18:33:12 -05:00
dresimpelo
961fd75d92 Resolve Merge Conflict
Very minor fix to clean up comment, erased blank line (line 209 basic_usage.md)
	Added a session close the Interactive Session in the 'Getting Started' tutorial
		-so that no exceptions are thrown when a user tests later examples in the same python kernel.
	Highlighted 't[i,j,k]' for read consistency in tutorial (line 21, resources/dim_types.md)

Change-Id: I9c0d8a6f6651bbb6a00bddecc0977b512e394669
2015-12-07 23:06:10 +00:00
Dongjoon Hyun
c842c58716 TensorFlow: Add a port mapping option for docker command.
Changes:

* Add port mapping options to `docker run` commands in
  docker_run_gpu.sh and README.md. Docker on Mac needs an extra option
  `-p` to expose 8888 for Jupyter Notebook. The added option makes the
  behavior of containers consistent on both Ubuntu and Mac.

Change-Id: I29002329f08d7dc05415925e9b2aedbd3f112813
2015-12-07 18:50:39 +09:00
Vijay Vasudevan
17b095cdec TensorFlow: Merge changes from internal (navbar website update) 2015-12-06 20:38:13 -08:00
Vijay Vasudevan
11e3d0faf2 Change 109547811
TensorFlow: update left nav bar

Base CL: 109547821
2015-12-06 20:37:24 -08:00
Vijay Vasudevan
f29c9d5f65 TensorFlow: merge changes from internal 2015-12-06 20:08:39 -08:00
Vijay Vasudevan
7e9067e439 Clean up the introductory text of a tutorial
Change 109544196
	Clean up the introductory text of the tutorial.

Base CL: 109546821
2015-12-06 20:06:15 -08:00
Vijay Vasudevan
f0b18a2364 TensorFlow: merge one more commit from internal 2015-12-06 16:39:01 -08:00
Vijay Vasudevan
6129b89340 TensorFlow: upstream changes to git
Change 109540764
	TensorFlow: some edits to image_recognition tutorial.

Base CL: 109540774
2015-12-06 16:35:40 -08:00
Vijay Vasudevan
ad50dafe8d TensorFlow: merge commits from internal 2015-12-06 15:26:35 -08:00
Vijay Vasudevan
f9d3e9d03c TensorFlow: upstream latest changes to git.
Change 109537918
	TensorFlow pip setup: wheel >= 0.26 for python3 pip install
Change 109505848
	Fix distortion default value to 1.0 in fixed_unigram_candidate_sampler. This means we default to the actual provided unigram distribution, instead of to the uniform (as it is currently).
Change 109470494
	Bugfix in gradients calculation when the ys rely on each other.
Change 109467619
	Fix CIFAR-10 model to train on all the training data instead of just 80% of it. Fixes #396.
Change 109467557
	Replaced checkpoint file with binary GraphDef.
Change 109467433
	Updates to C++ tutorial section.
Change 109465269
	TensorFlow: update documentation for tutorials to not assume use of bazel
	(when possible).
Change 109462916
	A tutorial for image recognition to coincide with the release of the latest Inception image classification model.
Change 109462342
	Clear control dependencies in variable_scope.get_variable() when creating
	ops for the initializer.

	Add tests of various error conditions.
Change 109461981
	Various performance improvements in low-level node execution code paths.

	Speeds up ptb_word_lm on my desktop with a Titan X from
	3638 words per second to 3751 words per second (3.1% speedup).

	Changes include:

	o Avoided many strcmp operations per node execution and extra touches
	of cache lines in executor.cc, by making all the various IsMerge,
	IsSwitch, IsSend, etc. operations instead be based on an internal enum
	value that is pre-computed at Node construction time, rather than doing
	string comparisons against node->type_string().  We were doing about
	6 such comparisons per executed node.

	o Removed mutex_lock in executor.cc in ExecutorState::Process.  The
	lock was not needed and the comment about the iterations array being
	potentially resized is not true (the iterations arrays are created
	with a fixed size).  Checked with yuanbyu to confirm this.

	o Added new two-argument port::Tracing::ScopedAnnotation constructor
	that takes two StringPiece arguments, and only concatenates them
	lazily if tracing is enabled.  Also changed the code in
	platform/tracing.{h,cc} so that the ScopedAnnotation constructor and
	the TraceMe constructor can be inlined.

	o In BaseGPUDevice::Compute, used the two-argument ScopedAnnotation
	constructor to avoid doing StrCat(opkernel->name(), ":",
	op_kernel->type_string()) on every node execution on a GPU.

	o Introduced a new TensorReference class that just holds a reference to an
	underlying TensorBuffer, and requires an explicit Unref().

	o Changed the EventMgr interface to take a vector of TensorReference objects
	for EventMgr::ThenDeleteTensors, rather than a vector of Tensor objects.

	o Used TensorReference in a few places in gpu_util.cc

	o Minor: switched to using InlinedVectors in a few places to get better
	cache locality.
Change 109456692
	Updated the label_image example to use the latest Inception model
Change 109456545
	Provides classify_image which performs image recognition on a 1000 object label set.

	  $ ./classify_image
	  giant panda, panda, panda bear, coon bear, Ailuropoda melanoleuca (score = 0.88493)
	  indri, indris, Indri indri, Indri brevicaudatus (score = 0.00878)
	  lesser panda, red panda, panda, bear cat, cat bear, Ailurus fulgens (score = 0.00317)
	  custard apple (score = 0.00149)
	  earthstar (score = 0.00127)

Change 109455002
	TensorFlow: make the helper libraries for various models available
	in the pip package so that when users type:

	python translate.py ...

	the absolute import works.

	This change is supposed to help make our tutorials run without the
	*need* to use bazel.
Change 109450041
	TensorFlow: remove cifar and convolutional binary copies from pip install.
	Adds embedding and some other models to the list.
Change 109448520
	Move the description of a failing invariant from a comment into the dcheck-fail message text.
Change 109447577
	TensorBoard has release tagging (tensorboard/TAG)
	Also track TensorBoard changes (tensorboard/CHANGES)
Change 109444161
	Added ParseSingleSequenceExample + python wrappers + unit tests.
Change 109440864
	Update all the TensorFlow Dockerfiles, and simplify GPU containers.

	This change updates all four of our Dockerfiles to match the targets discussed
	in https://github.com/tensorflow/tensorflow/issues/149. The most notable
	change here is moving the GPU images to use the NVidia containers which
	include cudnn and other build-time dependencies, dramatically simplifying both
	the build and run steps.

	A description of which tags exist and get pushed where will be in a follow-up.
Change 109432591
	Some pylint and pydoc changes in saver.
Change 109430127
	Remove unused hydrogen components
Change 109419354
	The RNN api, although moved into python/ops/, remains undocumented.

	It may still change at any time.

Base CL: 109538006
2015-12-06 14:53:28 -08:00
Yuan (Terry) Tang
0fa0240491 Fix pylint install on Travis 2015-12-06 13:17:48 -05:00
terrytangyuan
eda27a7637 Correctly trigger pylint 2015-12-06 11:50:46 -05:00
terrytangyuan
91a336c0f8 Fixed wrong path for install script 2015-12-06 11:36:39 -05:00
terrytangyuan
938107d82e seperate install by task 2015-12-06 11:32:34 -05:00
terrytangyuan
4e1386507c install/setup lint test 2015-12-06 11:31:52 -05:00
terrytangyuan
7e5d249eca Changed travis test structure; Added lint test 2015-12-06 11:24:42 -05:00
terrytangyuan
ad11530879 Added multiple GPUs example to README (+1 squashed commit)
Squashed commits:
[38746e1] Added multiple GPUs example to README
2015-12-06 00:13:33 -05:00
terrytangyuan
afeec64c63 Added example of using multiple GPUs 2015-12-06 00:06:59 -05:00
terrytangyuan
06c5567d3b Add parameter to log device replacement 2015-12-05 23:53:02 -05:00
terrytangyuan
5f1a6a4e38 Remove unnecessarily assigned variable for summary writer 2015-12-05 23:45:13 -05:00
Illia Polosukhin
e82fccc9cc Added more comments into text classification 2015-12-05 18:43:41 -08:00
terrytangyuan
370beed492 Made summary writer optional 2015-12-05 13:02:32 -05:00
terrytangyuan
2c30a0b17c Docstring for summary writer 2015-12-05 12:04:15 -05:00
terrytangyuan
508c21ee7d Added logdir with timestamp 2015-12-05 12:00:36 -05:00
Illia Polosukhin
87d008c74a added returns comment to partial_fit 2015-12-04 23:54:38 -08:00