Commit Graph

98737 Commits

Author SHA1 Message Date
Yong Tang
3e5520b7c8 Update SQLite to the lastest sqlite-amalgamation-3340000
This PR updates SQLite to the latest sqlite-amalgamation-3340000

Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
2021-01-04 11:23:42 -08:00
Yong Tang
b31100779f fix modular_filesystem call itself
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
2020-12-29 10:01:44 -08:00
rhdong
a26eed261e Merge pull request #43269 from rhdong:Mutablehashtable lookup support full size dynamic default values.
This PR is one part of RFC:https://github.com/tensorflow/community/pull/237
2020-12-21 11:10:07 +08:00
Abolfazl Shahbazi
fbd8345ec3 Peg docker version to '<=4.3.0' for partials 2020-12-17 13:36:54 -08:00
Abolfazl Shahbazi
03e9740b13 Other misc fixes for OneDNN Dockerfiles 2020-12-17 13:25:50 -08:00
Abolfazl Shahbazi
07d3ebc3f4 Fix for 'Horovod>0.19.5' installation 2020-12-17 13:15:49 -08:00
Austin Anderson
92577de23c Add Cuda 11 custom-op Dockerfile 2020-12-15 12:36:44 -08:00
Mihai Maruseac
5485ec964e
Merge pull request #45677 from tensorflow/update_v
update estimator version after estimator final release
2020-12-14 19:38:08 -08:00
Geeta Chavan
6efeac5d6f update estimator version after estimator final release 2020-12-14 16:30:57 -08:00
Mihai Maruseac
582c8d236c
Merge pull request #44220 from tensorflow-jenkins/relnotes-2.4.0rc0-18048
Update release notes for TensorFlow 2.4.0
2020-12-11 17:37:22 -08:00
Mihai Maruseac
c16387f692
Update RELEASE.md 2020-12-11 17:34:19 -08:00
Mihai Maruseac
4cf406c8a6
Update RELEASE.md 2020-12-11 17:34:02 -08:00
Mihai Maruseac
3f35ef2452
Update RELEASE.md 2020-12-11 17:33:53 -08:00
Mihai Maruseac
3647e8ec38
Update RELEASE.md 2020-12-11 17:33:42 -08:00
Mihai Maruseac
281c7d5405
Update RELEASE.md 2020-12-11 17:33:34 -08:00
Mihai Maruseac
91ec75f872
Update RELEASE.md 2020-12-11 17:32:53 -08:00
Mihai Maruseac
ed5ad82e76
Update RELEASE.md 2020-12-11 17:32:40 -08:00
Mihai Maruseac
1267bba748
Update RELEASE.md 2020-12-11 17:32:33 -08:00
Mihai Maruseac
13a4067a16
Update RELEASE.md 2020-12-11 17:32:25 -08:00
Mihai Maruseac
0a9a955db7
Update RELEASE.md 2020-12-11 17:32:17 -08:00
Mihai Maruseac
c0a05630a5
Update RELEASE.md 2020-12-11 17:32:05 -08:00
Goldie Gadde
c23d362f44
Update RELEASE.md 2020-12-11 17:21:50 -08:00
Goldie Gadde
a019a5ba7c
Update RELEASE.md 2020-12-11 15:33:35 -08:00
Milan Straka
5a190aca86 Only use site.USER_SITE is ENABLE_USER_SITE is set
Fixes loading packages from user site even in a virtual environment.

Should fix #42978.
2020-12-11 22:26:51 +01:00
Reed
efb9519cc7
Add mixed precision issue to "Known Caveats" 2020-12-10 18:13:45 -08:00
Reed
d39604eaaa
Add known caveat for mixed precision 2020-12-10 16:34:36 -08:00
Mihai Maruseac
7beefe17ee
Merge pull request #45559 from tensorflow-jenkins/version-numbers-2.4.0-22689
Update version numbers for TensorFlow 2.4.0
2020-12-10 08:06:08 -08:00
Mihai Maruseac
dd8b944f71
Merge pull request #45562 from angerson/r2.4
Dockerfiles: Pin pip version and fix apt-get
2020-12-10 08:05:51 -08:00
Austin Anderson
4604920209 Dockerfiles: Pin pip version and fix apt-get 2020-12-09 15:19:54 -08:00
TensorFlow Release Automation
185fc3086c Update version numbers to 2.4.0 2020-12-09 15:04:06 -08:00
Mihai Maruseac
f312e2a619
Update RELEASE.md 2020-12-09 14:44:46 -08:00
Mihai Maruseac
03a36aaa2e
Merge pull request #45553 from tensorflow/mm-cherry-pick-pcre-fixes-on-r2.4
Update PCRE library from 8.42 to 8.44
2020-12-09 14:16:45 -08:00
Mihai Maruseac
a0b8138187
Merge pull request #45503 from tensorflow/mm-cherrypick-0cc38aaa4064fd9e79101994ce9872c6d91f816b-on-r2.4
Prevent unitialized memory access in `GraphConstructor::MakeEdge`
2020-12-09 11:49:34 -08:00
Mihai Maruseac
2edfba82db
Merge pull request #45502 from tensorflow/mm-cherrypick-14755416e364f17fb1870882fa778c7fec7f16e3-on-r2.4
Prevent CHECK-fail in LSTM/GRU with zero-length input.
2020-12-09 11:49:04 -08:00
Mihai Maruseac
f1c5f5b39c
Merge pull request #45501 from tensorflow/mm-cherrypick-8b5b9dc96666a3a5d27fad7179ff215e3b74b67c-on-r2.4
Completely rewrite `GetMatchingPaths`.
2020-12-09 11:48:49 -08:00
Mihai Maruseac
6cb7d9ea3c
Merge pull request #45500 from tensorflow/mm-cherrypick-c1e1fc899ad5f8c725dcbb6470069890b5060bc7-on-r2.4
Mark `MemmappedTensorAllocator` as returning opaque handle.
2020-12-09 11:48:37 -08:00
Mihai Maruseac
8f28cfead9
Merge pull request #45499 from tensorflow/mm-cherrypick-ebc70b7a592420d3d2f359e4b1694c236b82c7ae-on-r2.4
Validate that `DataFormat*` attributes form a permutation.
2020-12-09 11:48:15 -08:00
Mihai Maruseac
3c52644e76
Merge pull request #45498 from tensorflow/mm-cherrypick-ace0c15a22f7f054abcc1f53eabbcb0a1239a9e2-on-r2.4
Default initialize fixed point Eigen types.
2020-12-09 11:47:36 -08:00
Yong Tang
b1b18bbbbf Update PCRE library from 8.42 to 8.44
This PR updates PCRE library from 8.42 to 8.44.

Note there is a CVS related to old 8.42 (https://nvd.nist.gov/vuln/detail/CVE-2019-20838#VulnChangeHistorySection)

Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
2020-12-09 11:23:54 -08:00
Mihai Maruseac
7664e65c2c Prevent unitialized memory access in GraphConstructor::MakeEdge
The `MakeEdge` implementation assumes that there exists an output at `output_index` of `src` node and an input at `input_index` of `dst` node. However, if this is not the case this results in accessing data out of bounds. Because we are accessing an array that is a private member of a class and only in read only mode, this usually results only in unitialized memory access. However, it is reasonable to think that malicious users could manipulate these indexes to actually read data outside the class, thus resulting in information leakage and further exploits.

PiperOrigin-RevId: 346343288
Change-Id: I2127da27c2023d27f26efd39afa6c853385cab6f
2020-12-08 17:41:30 -08:00
Mihai Maruseac
b550171e78 Prevent CHECK-fail in LSTM/GRU with zero-length input.
PiperOrigin-RevId: 346239181
Change-Id: I5f233dbc076aab7bb4e31ba24f5abd4eaf99ea4f
2020-12-08 17:41:20 -08:00
Mihai Maruseac
18d54d1586 Completely rewrite GetMatchingPaths.
The current parallel implementation is too complex (lambda inside lambda, two levels of parallelism) and has a read outside of bounds issue.

The new implementation cleans up artifacts from the previous implementations that were left in the code as it evolves. We add multiple helper functions, and document invariants and preconditions as well as every major step. This way, we fix the security issue and a potential new one which was not caught before

PiperOrigin-RevId: 346146220
Change-Id: Iec0f44673f43349797bf9944dffe9b2f779137d8
2020-12-08 17:40:06 -08:00
Mihai Maruseac
eccdffd4ba Mark MemmappedTensorAllocator as returning opaque handle.
This allocator is used for `ImmutableConstantOp` and it returns a handle to the contents of a memory mapped file which is supposed to represent a tensor.

For tensors of complex types (resources, variables and strings), allocators which are not marked as returning opaque handles will call placement new to initialize each element. This means writing to the buffer. However, in our case, the buffer is immutable and already contains the tensor data. Hence, writing to it is both destructive and causes a crash.

PiperOrigin-RevId: 345786451
Change-Id: I46369c50fa60b3431709ffe068a728d3061f49c4
2020-12-08 17:32:05 -08:00
Mihai Maruseac
ffea023937 Validate that DataFormat* attributes form a permutation.
The `src_format` and `dst_format` attributes for the `DataFormatDimMap` and `DataFormatVecPermute` raw ops are supposed to determine a permutation. However, this was not validated and could result in unitialized memory accesses as well as writes outside of bounds and potential crashes.

While here, we also test that the format attributes have the needed length, add tests for all validation failure cases, remove unnecessary calls to `strings::StrCat`, and fix a few grammar errors.

This will be cherry-picked on the supported release branches.

PiperOrigin-RevId: 346135579
Change-Id: I1c76392382c89ad8f072d5bc93d70669851eb404
2020-12-08 17:31:54 -08:00
Mihai Maruseac
1b3546b184 Default initialize fixed point Eigen types.
In certain cases, tensors are filled with default values of the type. But, for these fixed point types, these values were uninitialized. Thus, we would have uninitialized memory access bugs, some of which were caught by MSAN.

PiperOrigin-RevId: 344101137
Change-Id: I14555fda74dca3b5f1582da9008901937e3f14e2
2020-12-08 17:31:45 -08:00
Mihai Maruseac
5bf048973c
Merge pull request #45408 from ROCmSoftwarePlatform/google_upstream_r24_rocm_updates
[ROCm][r2.4]Porting changes from master to switch to ROCm 3.9
2020-12-08 16:59:53 -08:00
Mihai Maruseac
dcc57e7bf7
Merge pull request #45391 from terryheo/r2.4-fix-tflite-memoryplanner
tflite: Prevent from reallocation of persistent tensors
2020-12-08 16:59:37 -08:00
Deven Desai
aa39573ee1 Populating memory bandwidth information in the DeviceDescription, using information from the call to hipGetDeviceProperties 2020-12-04 19:24:47 +00:00
Goldie Gadde
97c3fef64b
Merge pull request #45390 from k-w-w/r2.4
Revert recent SavedModel changes
2020-12-03 19:09:50 -08:00
Terry Heo
9b87db80e0 tflite: Prevent from reallocation of persistent tensors
After ResetAllocationsAfter() is called, CalculateAllocations() could be called
again for nodes which have persistent temporary tensors. The logic should
prevent from reallocation of these tensors since they're not going to be
initialized again.

This issue could be reproduced easily with hybrid quantized models since some
hybrid kernels are using persistent temporary tensors.

This PR resolves GitHub issue #44520.

PiperOrigin-RevId: 345569003
Change-Id: I1b9777b33a664ebd0f09df8d3236c7ece0118b1a
2020-12-04 11:51:44 +09:00