mirror of
https://github.com/zebrajr/pytorch.git
synced 2025-12-07 00:21:07 +01:00
Summary: Sometimes local_shards are empty on some ranks, and out.dtype is float16, which will cause error if enforce_dtype is True because `data` will be float32. Callers know best what dtype they want, so we can just let callers decide. Temporarily keep enforce_dtype for backward compatibility Test Plan: Run local and MAST job Reviewed By: uciyc123 Differential Revision: D46886551 Pull Request resolved: https://github.com/pytorch/pytorch/pull/110561 Approved by: https://github.com/wanchaol, https://github.com/malfet |
||
|---|---|---|
| .. | ||
| checkpoint | ||
| sharded_optim | ||
| sharded_tensor | ||
| sharding_plan | ||
| sharding_spec | ||
| __init__.py | ||
| _utils.py | ||
| api.py | ||
| common_op_utils.py | ||
| metadata.py | ||
| op_registry_utils.py | ||
| sharder.py | ||