pytorch/torch/distributed/tensor/parallel
fduwjj 89b1e67d0a [Tensor Parallel] Add a new Colwise Parallel style when Pairwise cannot directly used (#100137)
Some use cases, users cannot directly `PairwiseParallelStyle` and they might need to specify colwise and rowwise separately.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/100137
Approved by: https://github.com/wz337
2023-04-28 03:27:51 +00:00
..
__init__.py [Tensor Parallel] Add a new Colwise Parallel style when Pairwise cannot directly used (#100137) 2023-04-28 03:27:51 +00:00
_utils.py [BE][DTensor] validate the mesh argument in DeviceMesh construction (#99094) 2023-04-21 23:47:51 +00:00
_view_with_dim_change.py [dtensor] use tracing for metadata prop (#95456) 2023-02-28 17:54:22 +00:00
api.py [Tensor Parallel] Add a new Colwise Parallel style when Pairwise cannot directly used (#100137) 2023-04-28 03:27:51 +00:00
fsdp.py [dtensor] refactor get_coordiniate (#95457) 2023-02-28 17:54:26 +00:00
multihead_attention_tp.py Fix typos under torch/distributed directory (#95638) 2023-03-27 21:13:44 +00:00
style.py [Tensor Parallel] Add a new Colwise Parallel style when Pairwise cannot directly used (#100137) 2023-04-28 03:27:51 +00:00