henrylhtsang 00ebbbb701 [cutlass backend] add addmm and bmm for cutlass backend benchmark (#152163) ... Copying what @kadeng did. ``` FINAL results... Experiment group: bmm (BS: 8, 1024x1024, 1024x1024) torch.float16 +-----------------------+--------------------+----------------------+---------------------+ | name | forward_time (us) | compilation_time (s) | perf_over_aten (%) | +-----------------------+--------------------+----------------------+---------------------+ | aten | 44.454172253608704 | 3.0991086587309837 | NA | | triton | 44.06978189945221 | 0.07496077567338943 | -0.8646890374284049 | | triton_persistent_tma | 43.598245829343796 | 0.06154991965740919 | -1.9254130284597197 | | cutlass_lvl_default | 39.91834074258804 | 0.056073310784995556 | -10.20338762612423 | +-----------------------+--------------------+----------------------+---------------------+ Experiment group: bmm (BS: 8, 1024x1024, 1024x1024) torch.bfloat16 +-----------------------+-------------------+----------------------+---------------------+ | name | forward_time (us) | compilation_time (s) | perf_over_aten (%) | +-----------------------+-------------------+----------------------+---------------------+ | aten | 49.05610531568527 | 0.160279156640172 | NA | | triton | 43.97720843553543 | 0.0660805031657219 | -10.353241145961718 | | triton_persistent_tma | 43.94153505563736 | 0.061738294549286366 | -10.425960697724962 | | cutlass_lvl_default | 40.2066633105278 | 0.034127906896173954 | -18.039430460713596 | +-----------------------+-------------------+----------------------+---------------------+ Average edge over aten (max(-edge, 0), higher is better): triton: 5.608965091695062 (from 2 valid values) triton_persistent_tma: 6.175686863092341 (from 2 valid values) cutlass_lvl_default: 14.121409043418913 (from 2 valid values) ``` Differential Revision: [D73625766](https://our.internmc.facebook.com/intern/diff/D73625766/) Pull Request resolved: https://github.com/pytorch/pytorch/pull/152163 Approved by: https://github.com/jingsh		2025-04-28 20:16:17 +00:00
..
cutlass.py	[cutlass backend] add addmm and bmm for cutlass backend benchmark (#152163)	2025-04-28 20:16:17 +00:00