OSSForks/pytorch
1
0
Fork 0
mirror of https://github.com/zebrajr/pytorch.git synced 2025-12-06 12:20:52 +01:00
Code Issues Actions 38 Packages Projects Releases Wiki Activity

[tp] additional doc fixes (#94786)

Browse Source 
Pull Request resolved: https://github.com/pytorch/pytorch/pull/94786
Approved by: https://github.com/fduwjj
This commit is contained in:
Wanchao Liang 2023-02-14 01:23:18 +00:00 committed by PyTorch MergeBot
parent 1f06a71797
commit 7522ca55f1
2 changed files with 4 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
docs/source/distributed.tensor.parallel.rst
View File

@ -4,8 +4,9 @@
Tensor Parallelism - torch.distributed.tensor.parallel Tensor Parallelism - torch.distributed.tensor.parallel
====================================================== ======================================================
Tensor Parallelism(TP) is built on top of DistributedTensor(DTensor) and Tensor Parallelism(TP) is built on top of the PyTorch DistributedTensor
provides several Parallelism styles: Rowwise, Colwise and Pairwise Parallelism. (`DTensor https://github.com/pytorch/pytorch/blob/master/torch/distributed/_tensor/README.md`__)
and provides several parallelism styles: Rowwise, Colwise and Pairwise Parallelism.
.. warning :: .. warning ::
Tensor Parallelism APIs are experimental and subject to change. Tensor Parallelism APIs are experimental and subject to change.

2
torch/distributed/tensor/parallel/api.py
View File

@ -68,7 +68,7 @@ def parallelize_module( # type: ignore[return]
Example:: Example::
>>> # xdoctest: +SKIP("distributed") >>> # xdoctest: +SKIP("distributed")
>>> from torch.distributed._tensor.parallel import parallelize_module, PairwiseParallel >>> from torch.distributed.tensor.parallel import parallelize_module, PairwiseParallel
>>> >>>
>>> # Define the module. >>> # Define the module.
>>> m = Model(...) >>> m = Model(...)