pytorch/benchmarks/dynamo/ci_expected_accuracy
LifengWang e40a9e602b Add the max_autotune tests in the periodic jobs. (#143560)
To promptly detect issues with max_autotune, such as [#143102](https://github.com/pytorch/pytorch/issues/143102), add the max_autotune tests to the periodic CI to track the accuracy regularly.

Pull Request resolved: https://github.com/pytorch/pytorch/pull/143560
Approved by: https://github.com/leslie-fang-intel, https://github.com/desertfire
2025-03-12 01:47:46 +00:00
..
cu124 [dynamo] Remove HFPretrained config hack (#143698) 2024-12-28 02:03:13 +00:00
rocm Update dynamo expected 20250210 (#146856) 2025-02-12 18:01:20 +00:00
aot_eager_huggingface_inference.csv [dynamo] Remove HFPretrained config hack (#143698) 2024-12-28 02:03:13 +00:00
aot_eager_huggingface_training.csv [dynamo] Remove HFPretrained config hack (#143698) 2024-12-28 02:03:13 +00:00
aot_eager_timm_inference.csv [BE] Bump TIMM pin (#145320) 2025-01-23 20:44:26 +00:00
aot_eager_timm_training.csv [CI] [inductor] Add cu126 inductor jobs and move away cu124 (#148612) 2025-03-07 18:30:14 +00:00
aot_eager_torchbench_inference.csv Update dynamo expected 20250210 (#146856) 2025-02-12 18:01:20 +00:00
aot_eager_torchbench_training.csv [CI] [inductor] Add cu126 inductor jobs and move away cu124 (#148612) 2025-03-07 18:30:14 +00:00
aot_inductor_huggingface_inference.csv [AOTI] Switch benchmarking to use export non-strict mode (#130977) 2024-08-29 16:08:52 +00:00
aot_inductor_timm_inference.csv [BE] Bump TIMM pin (#145320) 2025-01-23 20:44:26 +00:00
aot_inductor_torchbench_inference.csv Update TorchBench commit to main (#145455) 2025-02-01 06:44:26 +00:00
cpu_aot_inductor_amp_freezing_torchbench_inference.csv Update TorchBench commit to main (#145455) 2025-02-01 06:44:26 +00:00
cpu_aot_inductor_freezing_huggingface_inference.csv Fix dynamo benchmark skip logic for cpu device (#135193) 2024-09-10 03:02:19 +00:00
cpu_aot_inductor_freezing_timm_inference.csv Update TorchBench commit to main (#145455) 2025-02-01 06:44:26 +00:00
cpu_aot_inductor_freezing_torchbench_inference.csv Update TorchBench commit to main (#145455) 2025-02-01 06:44:26 +00:00
cpu_inductor_amp_freezing_huggingface_inference.csv [dynamo] Remove HFPretrained config hack (#143698) 2024-12-28 02:03:13 +00:00
cpu_inductor_amp_freezing_timm_inference.csv [BE] Bump TIMM pin (#145320) 2025-01-23 20:44:26 +00:00
cpu_inductor_amp_freezing_torchbench_inference.csv Update dynamo expected 20250210 (#146856) 2025-02-12 18:01:20 +00:00
cpu_inductor_freezing_huggingface_inference.csv [dynamo] Remove HFPretrained config hack (#143698) 2024-12-28 02:03:13 +00:00
cpu_inductor_freezing_timm_inference.csv [BE] Bump TIMM pin (#145320) 2025-01-23 20:44:26 +00:00
cpu_inductor_freezing_torchbench_inference.csv Update dynamo expected 20250210 (#146856) 2025-02-12 18:01:20 +00:00
cpu_inductor_huggingface_inference.csv [dynamo] Remove HFPretrained config hack (#143698) 2024-12-28 02:03:13 +00:00
cpu_inductor_timm_inference.csv [BE] Bump TIMM pin (#145320) 2025-01-23 20:44:26 +00:00
cpu_inductor_torchbench_inference.csv [dynamo] Use polyfill to implement comparison operators (#144485) 2025-02-06 17:27:07 +00:00
dynamic_aot_eager_huggingface_inference.csv [dynamo] Remove HFPretrained config hack (#143698) 2024-12-28 02:03:13 +00:00
dynamic_aot_eager_huggingface_training.csv [dynamo] Remove HFPretrained config hack (#143698) 2024-12-28 02:03:13 +00:00
dynamic_aot_eager_timm_inference.csv [BE] Bump TIMM pin (#145320) 2025-01-23 20:44:26 +00:00
dynamic_aot_eager_timm_training.csv [CI] [inductor] Add cu126 inductor jobs and move away cu124 (#148612) 2025-03-07 18:30:14 +00:00
dynamic_aot_eager_torchbench_inference.csv Update dynamo expected 20250210 (#146856) 2025-02-12 18:01:20 +00:00
dynamic_aot_eager_torchbench_training.csv Update TorchBench commit to main (#145455) 2025-02-01 06:44:26 +00:00
dynamic_cpu_aot_inductor_amp_freezing_torchbench_inference.csv Update TorchBench commit to main (#145455) 2025-02-01 06:44:26 +00:00
dynamic_cpu_aot_inductor_freezing_torchbench_inference.csv Update TorchBench commit to main (#145455) 2025-02-01 06:44:26 +00:00
dynamic_cpu_inductor_huggingface_inference.csv [dynamo] Remove HFPretrained config hack (#143698) 2024-12-28 02:03:13 +00:00
dynamic_cpu_inductor_timm_inference.csv [BE] Bump TIMM pin (#145320) 2025-01-23 20:44:26 +00:00
dynamic_cpu_inductor_torchbench_inference.csv [dynamo] Use polyfill to implement comparison operators (#144485) 2025-02-06 17:27:07 +00:00
dynamic_cpu_max_autotune_inductor_amp_freezing_huggingface_inference.csv Add the max_autotune tests in the periodic jobs. (#143560) 2025-03-12 01:47:46 +00:00
dynamic_cpu_max_autotune_inductor_amp_freezing_timm_inference.csv Add the max_autotune tests in the periodic jobs. (#143560) 2025-03-12 01:47:46 +00:00
dynamic_cpu_max_autotune_inductor_amp_freezing_torchbench_inference.csv Add the max_autotune tests in the periodic jobs. (#143560) 2025-03-12 01:47:46 +00:00
dynamic_inductor_huggingface_inference.csv [dynamo] Remove HFPretrained config hack (#143698) 2024-12-28 02:03:13 +00:00
dynamic_inductor_huggingface_training.csv [dynamo] Remove HFPretrained config hack (#143698) 2024-12-28 02:03:13 +00:00
dynamic_inductor_timm_inference.csv Update TorchBench commit to main (#145455) 2025-02-01 06:44:26 +00:00
dynamic_inductor_timm_training.csv [CI] Update crossvit_9_240 as pass (#148989) 2025-03-11 20:54:39 +00:00
dynamic_inductor_torchbench_inference.csv Update dynamo expected 20250210 (#146856) 2025-02-12 18:01:20 +00:00
dynamic_inductor_torchbench_training.csv [CI] [inductor] Add cu126 inductor jobs and move away cu124 (#148612) 2025-03-07 18:30:14 +00:00
dynamo_eager_huggingface_inference.csv [dynamo] Remove HFPretrained config hack (#143698) 2024-12-28 02:03:13 +00:00
dynamo_eager_huggingface_training.csv [dynamo] Remove HFPretrained config hack (#143698) 2024-12-28 02:03:13 +00:00
dynamo_eager_timm_inference.csv [BE] Bump TIMM pin (#145320) 2025-01-23 20:44:26 +00:00
dynamo_eager_timm_training.csv [BE] Bump TIMM pin (#145320) 2025-01-23 20:44:26 +00:00
dynamo_eager_torchbench_inference.csv Update dynamo expected 20250210 (#146856) 2025-02-12 18:01:20 +00:00
dynamo_eager_torchbench_training.csv Update TorchBench commit to main (#145455) 2025-02-01 06:44:26 +00:00
inductor_huggingface_inference.csv [dynamo] Remove HFPretrained config hack (#143698) 2024-12-28 02:03:13 +00:00
inductor_huggingface_training.csv [dynamo] Remove HFPretrained config hack (#143698) 2024-12-28 02:03:13 +00:00
inductor_timm_inference.csv Update TorchBench commit to main (#145455) 2025-02-01 06:44:26 +00:00
inductor_timm_training.csv [CI] Update crossvit_9_240 as pass (#148989) 2025-03-11 20:54:39 +00:00
inductor_torchbench_inference.csv [dynamo] Use polyfill to implement comparison operators (#144485) 2025-02-06 17:27:07 +00:00
inductor_torchbench_training.csv [CI] [inductor] Add cu126 inductor jobs and move away cu124 (#148612) 2025-03-07 18:30:14 +00:00
update_expected.py Update TorchBench commit to main (#145455) 2025-02-01 06:44:26 +00:00