Mikayla Gawarecki a7306de0dc Add RMSNorm module (#121364) ... Similar to dbeed9724b/torchmultimodal/modules/layers/normalizations.py (L51) **The implementation here is not optimized and we welcome pull requests to improve this** - Use `normalized_shape` instead of singular integer `dim` to be aligned with the `nn.LayerNorm` implementation - Remove the [upcast to float and downcast ](dbeed9724b/torchmultimodal/modules/layers/normalizations.py (L73)) Pull Request resolved: https://github.com/pytorch/pytorch/pull/121364 Approved by: https://github.com/albanD		2024-03-27 21:39:30 +00:00
..
_internal	Add RMSNorm module (#121364)	2024-03-27 21:39:30 +00:00
__init__.py
_comparison.py	[BE]: Apply RUF025 dict.fromkeys preview rule (#118637)	2024-01-30 20:46:54 +00:00
_creation.py	additional support for float8_e4m3fnuz and _e5m2fnuz (#115214)	2024-01-22 18:33:41 +00:00