Will Constable 346343e6b5 [DeviceMesh] Make _validate_tp_mesh_dim support 3D (#125763) ... Currently a 3D mesh with a submesh sliced out for TP is going to fail this check. According to @wanchaol in [this comment](https://github.com/pytorch/pytorch/pull/125250#discussion_r1586653669) it should be OK to remove these checks. Though I would appreciate a more careful review here, since I'm not too sure if there are other edge cases where these checks are important. Pull Request resolved: https://github.com/pytorch/pytorch/pull/125763 Approved by: https://github.com/wz337, https://github.com/wanchaol		2024-05-08 21:22:11 +00:00
..
parallel	[DeviceMesh] Make _validate_tp_mesh_dim support 3D (#125763)	2024-05-08 21:22:11 +00:00
__init__.py