pytorch/torch/compiler
Oguz Ulgen 57addfcd58 Significantly speed up save_cache_artifacts (#148227)
While using save_cache_artifacts on internal workloads, we have noticed that repeatedly calling this function after every batch is incredibly expensive. This PR significantly speeds up this function call by opting out of pickle and redesigning serialization algorithm.

Essentially what we want is to be able to call serialize many times without incurring costs from scratch.

Pull Request resolved: https://github.com/pytorch/pytorch/pull/148227
Approved by: https://github.com/jamesjwu
ghstack dependencies: #148226
2025-03-03 17:28:41 +00:00
..
__init__.py PEP585: More UP006 fixes (#146392) 2025-02-20 06:18:13 +00:00
_cache.py Significantly speed up save_cache_artifacts (#148227) 2025-03-03 17:28:41 +00:00
config.py Support whitelist of dynamic sources (#147979) 2025-02-28 15:43:14 +00:00