Xu Zhao
|
1e818db547
|
[torchbench] Fix torchao benchmarking script (#126736)
As the title says.
Test Plan:
```
python benchmarks/dynamo/torchbench.py --only BERT_pytorch --bfloat16 --quantization int8dynamic --performance --inference --print-memory
cuda eval BERT_pytorch
[XZ Debug] Torch grad status: False
memory: eager: 0.82 GB, dynamo: 0.92 GB, ratio: 0.89
running benchmark: 100%
1.001x
```
Pull Request resolved: https://github.com/pytorch/pytorch/pull/126736
Approved by: https://github.com/jerryzh168, https://github.com/huydhn
|
2024-05-21 23:15:12 +00:00 |
|