8134117476
Imported from GitHub PR https://github.com/openxla/xla/pull/32836 📝 Summary of Changes Updated SINGLE_HOST communication type to SINGLE_PARTITION (fast-interconnect domain) to meet the need of multi-node NVLink (MNNVL) topology. Piped auto-detected partition size for communication type determination, also exposed partition size in SolGPUCostModel::Config for AOT compilation. 🎯 Justification S-curve model cannot handle NVLink latency, single fast-interconnect domain including MNNVL topology should use latency table model. This PR updates the routing mechanism so that MNNVL will be treated as a single partition, while previously host is assumed equivalent to partition. 🚀 Kind of Contribution ✨ New Feature 📊 Benchmark (for Performance Improvements) N/A 🧪 Unit Tests: Added unit tests for model dispatching mechanism. 🧪 Execution Tests: Behavior unchanged for non-MNNVL topology, N/A. Copybara import of the project: -- a9544375934873f7b888fdb5ff6c9dc6ee8b0e6c by Terry Sun <tesun@nvidia.com>: use partition size for static model dispatching -- e3445a5deb8da10146e90c50da5598f91cfe0a69 by Terry Sun <tesun@nvidia.com>: expose partition size to config -- 212535ce891b8eb96ebb3c1e215a91d2b5035594 by Terry Sun <tesun@nvidia.com>: better modularity -- a9fe8a0f89dea9e2811d76a3570c7398df8dd756 by Terry Sun <tesun@nvidia.com>: better code structure and doc string -- a64a2b5ed1d45d815c6a2c47628b4d9ebb8368bd by Terry Sun <tesun@nvidia.com>: update naming Merging this change closes #32836 PiperOrigin-RevId: 826697791 |
||
|---|---|---|
| .github | ||
| ci | ||
| tensorflow | ||
| third_party | ||
| tools | ||
| .bazelignore | ||
| .bazelrc | ||
| .bazelversion | ||
| .clang-format | ||
| .gitignore | ||
| .pylintrc | ||
| .zenodo.json | ||
| arm_compiler.BUILD | ||
| AUTHORS | ||
| BUILD | ||
| CITATION.cff | ||
| CODE_OF_CONDUCT.md | ||
| CODEOWNERS | ||
| configure | ||
| configure.cmd | ||
| configure.py | ||
| CONTRIBUTING.md | ||
| ISSUES.md | ||
| LICENSE | ||
| models.BUILD | ||
| README.md | ||
| RELEASE.md | ||
| requirements_lock_3_9.txt | ||
| requirements_lock_3_10.txt | ||
| requirements_lock_3_11.txt | ||
| requirements_lock_3_12.txt | ||
| requirements_lock_3_13.txt | ||
| SECURITY.md | ||
| WORKSPACE | ||
Documentation |
|---|
 |
TensorFlow is an end-to-end open source platform for machine learning. It has a comprehensive, flexible ecosystem of tools, libraries, and community resources that lets researchers push the state-of-the-art in ML and developers easily build and deploy ML-powered applications.
TensorFlow was originally developed by researchers and engineers working within the Machine Intelligence team at Google Brain to conduct research in machine learning and neural networks. However, the framework is versatile enough to be used in other areas as well.
TensorFlow provides stable Python and C++ APIs, as well as a non-guaranteed backward compatible API for other languages.
Keep up-to-date with release announcements and security updates by subscribing to announce@tensorflow.org. See all the mailing lists.
Install
See the TensorFlow install guide for the pip package, to enable GPU support, use a Docker container, and build from source.
To install the current release, which includes support for CUDA-enabled GPU cards (Ubuntu and Windows):
$ pip install tensorflow
Other devices (DirectX and MacOS-metal) are supported using Device Plugins.
A smaller CPU-only package is also available:
$ pip install tensorflow-cpu
To update TensorFlow to the latest version, add --upgrade flag to the above
commands.
Nightly binaries are available for testing using the tf-nightly and tf-nightly-cpu packages on PyPI.
Try your first TensorFlow program
$ python
>>> import tensorflow as tf
>>> tf.add(1, 2).numpy()
3
>>> hello = tf.constant('Hello, TensorFlow!')
>>> hello.numpy()
b'Hello, TensorFlow!'
For more examples, see the TensorFlow Tutorials.
Contribution guidelines
If you want to contribute to TensorFlow, be sure to review the Contribution Guidelines. This project adheres to TensorFlow's Code of Conduct. By participating, you are expected to uphold this code.
We use GitHub Issues for tracking requests and bugs, please see TensorFlow Forum for general questions and discussion, and please direct specific questions to Stack Overflow.
The TensorFlow project strives to abide by generally accepted best practices in open-source software development.
Patching guidelines
Follow these steps to patch a specific version of TensorFlow, for example, to apply fixes to bugs or security vulnerabilities:
- Clone the TensorFlow repository and switch to the appropriate branch for
your desired version—for example,
r2.8for version 2.8. - Apply the desired changes (i.e., cherry-pick them) and resolve any code conflicts.
- Run TensorFlow tests and ensure they pass.
- Build the TensorFlow pip package from source.
Continuous build status
You can find more community-supported platforms and configurations in the TensorFlow SIG Build Community Builds Table.
Official Builds
| Build Type | Status | Artifacts |
|---|---|---|
| Linux CPU |  |
PyPI |
| Linux GPU |  |
PyPI |
| Linux XLA |  |
TBA |
| macOS |  |
PyPI |
| Windows CPU |  |
PyPI |
| Windows GPU |  |
PyPI |
| Android |  |
Download |
| Raspberry Pi 0 and 1 |  |
Py3 |
| Raspberry Pi 2 and 3 |  |
Py3 |
| Libtensorflow MacOS CPU | Status Temporarily Unavailable | Nightly Binary Official GCS |
| Libtensorflow Linux CPU | Status Temporarily Unavailable | Nightly Binary Official GCS |
| Libtensorflow Linux GPU | Status Temporarily Unavailable | Nightly Binary Official GCS |
| Libtensorflow Windows CPU | Status Temporarily Unavailable | Nightly Binary Official GCS |
| Libtensorflow Windows GPU | Status Temporarily Unavailable | Nightly Binary Official GCS |
Resources
- TensorFlow.org
- TensorFlow Tutorials
- TensorFlow Official Models
- TensorFlow Examples
- TensorFlow Codelabs
- TensorFlow Blog
- Learn ML with TensorFlow
- TensorFlow Twitter
- TensorFlow YouTube
- TensorFlow model optimization roadmap
- TensorFlow White Papers
- TensorBoard Visualization Toolkit
- TensorFlow Code Search
Learn more about the TensorFlow Community and how to Contribute.