OSSForks/tensorflow
1
0
Fork 0
mirror of https://github.com/zebrajr/tensorflow.git synced 2025-12-06 00:19:58 +01:00
Code Issues Actions 5 Packages Projects Releases Wiki Activity

Make tensorflow-io-gcs-filesystem an optional dependency.

Browse Source 
The dependency has been causing a number of issues, see:
https://github.com/tensorflow/tensorflow/pull/82771

The support for the package is currently uncertain, and has
been on the low end for a while - no Windows wheels since 0.32.0, for example.

It has been capped on <py3.12 for a while now also.

PiperOrigin-RevId: 731313825
This commit is contained in:
Vladimir Belitskiy 2025-02-26 07:43:13 -08:00 committed by TensorFlower Gardener
parent 864af685c1
commit 2c91388a06
2 changed files with 27 additions and 19 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
RELEASE.md
View File

@ -9,6 +9,9 @@
* <DOCUMENT BREAKING CHANGES HERE>
* <THIS SECTION SHOULD CONTAIN API, ABI AND BEHAVIORAL BREAKING CHANGES>
* The `tensorflow-io-gcs-filesystem` package is now optional, due its uncertain, and limited support.
To install it alongside `tensorflow`, run `pip install "tensorflow[gcs-filesystem]"`.
### Known Caveats
* <CAVEATS REGARDING THE RELEASE (BUT NOT BREAKING CHANGES).>

43
tensorflow/tools/pip_package/setup.py
View File

@ -97,8 +97,6 @@ REQUIRED_PACKAGES = [
'termcolor >= 1.1.0',
'typing_extensions >= 3.6.6',
'wrapt >= 1.11.0',
# TODO(b/305196096): Remove the <3.12 condition once the pkg is updated
'tensorflow-io-gcs-filesystem >= 0.23.1 ; python_version < "3.12"',
# grpcio does not build correctly on big-endian machines due to lack of
# BoringSSL support.
# See https://github.com/tensorflow/tensorflow/issues/17882.
@ -147,24 +145,31 @@ if collaborator_build:
]
# Set up extra packages, which are optional sets of other Python package deps.
# E.g. "pip install tensorflow[and-cuda]" below installs the normal TF deps
# E.g. "pip install tensorflow[and-cuda]" below installs the normal TF deps,
# plus the CUDA libraries listed.
EXTRA_PACKAGES = {}
EXTRA_PACKAGES['and-cuda'] = [
# TODO(nluehr): set nvidia-* versions based on build components.
'nvidia-cublas-cu12 == 12.5.3.2',
'nvidia-cuda-cupti-cu12 == 12.5.82',
'nvidia-cuda-nvcc-cu12 == 12.5.82',
'nvidia-cuda-nvrtc-cu12 == 12.5.82',
'nvidia-cuda-runtime-cu12 == 12.5.82',
'nvidia-cudnn-cu12 == 9.3.0.75',
'nvidia-cufft-cu12 == 11.2.3.61',
'nvidia-curand-cu12 == 10.3.6.82',
'nvidia-cusolver-cu12 == 11.6.3.83',
'nvidia-cusparse-cu12 == 12.5.1.3',
'nvidia-nccl-cu12 == 2.25.1',
'nvidia-nvjitlink-cu12 == 12.5.82',
]
EXTRA_PACKAGES = {
'and-cuda': [
# TODO(nluehr): set nvidia-* versions based on build components.
'nvidia-cublas-cu12 == 12.5.3.2',
'nvidia-cuda-cupti-cu12 == 12.5.82',
'nvidia-cuda-nvcc-cu12 == 12.5.82',
'nvidia-cuda-nvrtc-cu12 == 12.5.82',
'nvidia-cuda-runtime-cu12 == 12.5.82',
'nvidia-cudnn-cu12 == 9.3.0.75',
'nvidia-cufft-cu12 == 11.2.3.61',
'nvidia-curand-cu12 == 10.3.6.82',
'nvidia-cusolver-cu12 == 11.6.3.83',
'nvidia-cusparse-cu12 == 12.5.1.3',
'nvidia-nccl-cu12 == 2.25.1',
'nvidia-nvjitlink-cu12 == 12.5.82',
],
'gcs-filesystem': [
('tensorflow-io-gcs-filesystem>=0.23.1; '
'sys_platform!="win32" and python_version<"3.13"'),
('tensorflow-io-gcs-filesystem>=0.23.1; '
'sys_platform=="win32" and python_version<"3.12"'),
]
}
DOCLINES = __doc__.split('\n')