pytorch/benchmarks
Taylor Robie fab1795577 move benchmark utils into torch namespace (#41506)
Summary:
Move the timing utils to `torch.utils._benchmark`. I couldn't figure out how to get setuptools to pick it up and put it under `torch` unless it is in the `torch` directory. (And I think it has to be for `setup.py develop` anyway.)

I also modified the record function benchmark since `Timer` and `Compare` should always be available now.

Pull Request resolved: https://github.com/pytorch/pytorch/pull/41506

Reviewed By: ngimel

Differential Revision: D22601460

Pulled By: robieta

fbshipit-source-id: 9cea7ff1dcb0bb6922c15b99dd64833d9631c37b
2020-07-23 09:48:39 -07:00
..
distributed/ddp Add distributed data parallel benchmark tool (#35198) 2020-04-08 15:07:03 -07:00
fastrnns [JIT] make fastrnns runnable on cpu (#41483) 2020-07-16 15:53:39 -07:00
framework_overhead_benchmark Fix spelling errors 2020-01-28 04:46:15 -08:00
operator_benchmark Add quantized CELU operator by adding additional parameters to quantized ELU (#39199) 2020-07-17 17:56:33 -07:00
overrides_benchmark [RELAND] Add __torch_function__ benchmarks (#36138) 2020-04-10 09:14:31 -07:00
profiler_benchmark Destroy CUDA events after profiling (#39962) 2020-06-23 10:44:39 -07:00
record_function_benchmark move benchmark utils into torch namespace (#41506) 2020-07-23 09:48:39 -07:00
serialization [JIT] Make new zip serialization for torch save/load significantly (~70%) faster (#38379) 2020-05-29 01:56:18 -07:00
tensorexpr [TensorExpr] Fix imports in tensorexpr benchmarks. (#35830) 2020-04-01 14:23:33 -07:00
README.md Fix spelling errors 2020-01-28 04:46:15 -08:00

PyTorch Benchmarks

NOTE: This folder is currently work in progress.

This folder contains scripts that produce reproducible timings of various PyTorch features.

It also provides mechanisms to compare PyTorch with other frameworks.

Setup environment

Make sure you're on a machine with CUDA, torchvision, and pytorch installed. Install in the following order:

# Install torchvision. It comes with the pytorch stable release binary
conda install pytorch torchvision -c pytorch

# Install the latest pytorch master from source.
# It should supersede the installation from the release binary.
cd $PYTORCH_HOME
python setup.py build develop

# Check the pytorch installation version
python -c "import torch; print(torch.__version__)"

Benchmark List

Please refer to each subfolder to discover each benchmark suite