OSSForks/pytorch
1
0
Fork 0
mirror of https://github.com/zebrajr/pytorch.git synced 2025-12-07 12:21:27 +01:00
Code Issues Actions 38 Packages Projects Releases Wiki Activity
afa1eda901
pytorch/benchmarks/dynamo/pr_time_benchmarks
History
Jason Ansel a60b4ed623 [fx] Optimize TracerBase.create_arg and Graph._gen_python_code (#148292) 
Before: 19502951 function calls (18702776 primitive calls) in 8.533 seconds
After: 16402551 function calls (15602452 primitive calls) in 7.701 seconds

Pull Request resolved: https://github.com/pytorch/pytorch/pull/148292
Approved by: https://github.com/oulgen
ghstack dependencies: #148243, #148260, #148261, #148288
2025-03-10 16:06:19 +00:00
..
benchmarks Update ruff linter for PEP585 (#147540) 2025-02-22 04:45:17 +00:00
test_check_result Several enhancements for check_results.py (#137925) 2024-10-26 16:27:55 +00:00
__init__.py
benchmark_runner.sh [inductor] Minor compile time optimizations in DefaultHandler (#146282) 2025-02-08 18:00:40 +00:00
check_results.py Better log message to update pr_time_benchmarks/expected_results.csv (#148303) 2025-03-09 17:12:47 +00:00
expected_results.csv [fx] Optimize TracerBase.create_arg and Graph._gen_python_code (#148292) 2025-03-10 16:06:19 +00:00
log_benchmarking_time.py Only keep ListOfLinears module in basic_modules_benchmarks and add gpu version. (#135730) 2024-09-14 16:45:52 +00:00
README.md add README.md for compile time benchmarks (#143145) 2024-12-13 05:12:26 +00:00

README.md

Instructions on how to make a new compile time benchmark

  1. Make a new benchmark file in /benchmarks/dynamo/pr_time_benchmarks/benchmarks/ eg. 0b75b7ff2b/benchmarks/dynamo/pr_time_benchmarks/benchmarks/add_loop.py
  2. cd into the pr_time_benchmarks directory cd benchmarks/dynamo/pr_time_benchmarks
  3. Run PYTHONPATH=./ python benchmarks/[YOUR_BENCHMARK].py a.txt
  4. (Optional) flip a flag that you know will change the benchmark and run again with b.txt PYTHONPATH=./ python benchmarks/[YOUR_BENCHMARK].py a.txt
  5. Compare a.txt and b.txt located within the benchmarks/dynamo/pr_time_benchmarks folder to make sure things look as you expect
  6. Check in your new benchmark file and submit a new PR
  7. In a few days, if your benchmark is stable, bug Laith Sakka to enable running your benchmark on all PRs. If your a meta employee, you can find the dashboard here: internalfb.com/intern/unidash/dashboard/pt2_diff_time_metrics