David Berard e52dc9888b Retry - [NVFuser] always use fallback if fusion fails ... Retry of #75983. The change is to handle cases where attr::cache_id is not set. This can happen if compilation fails. Original message: 1) remember when fusions fail; and on subsequent runs, always take the fallback. 2) during the first fallback, cache the Code object. On autogen-69 from the nvfuser microbenchmarks (https://github.com/pytorch/benchmark/pull/801) this improved performanance as follows: * Original (always attempt fusion): 25ms * Always take fallback after first failure: 0.79ms * Always take fallback + cache Code object: 0.62ms * Eager: 0.58ms Pull Request resolved: https://github.com/pytorch/pytorch/pull/76505 Approved by: https://github.com/eellison		2022-04-28 20:38:37 +00:00
..
cuda	Retry - [NVFuser] always use fallback if fusion fails	2022-04-28 20:38:37 +00:00
fuser	Enable win-arm64	2022-02-28 17:17:56 +00:00