OSSForks/pytorch
1
0
Fork 0
mirror of https://github.com/zebrajr/pytorch.git synced 2025-12-07 12:21:27 +01:00
Code Issues Actions 38 Packages Projects Releases Wiki Activity

[dtensor] readme typo (#115383)

Browse Source 
Pull Request resolved: https://github.com/pytorch/pytorch/pull/115383
Approved by: https://github.com/awgu
ghstack dependencies: #115365
This commit is contained in:
Wanchao Liang 2023-12-07 14:22:50 -08:00 committed by PyTorch MergeBot
parent af925a56a1
commit 1215f2ffe2
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
torch/distributed/_tensor/README.md
View File

@ -57,7 +57,7 @@ import torch
from torch.distributed._tensor import DTensor, Shard, Replicate, distribute_tensor, distribute_module, init_device_mesh
# construct a device mesh with available devices (multi-host or single host)
device_mesh = init_device_mesh("cuda", )
device_mesh = init_device_mesh("cuda", (4,))
# if we want to do row-wise sharding
rowwise_placement=[Shard(0)]
# if we want to do col-wise sharding