mirror of
https://github.com/zebrajr/pytorch.git
synced 2025-12-07 12:21:27 +01:00
Summary: Introduce a utility class AOTIModelRunner to take care of running an AOTInductor compiled model. It does things like dlopen a model, initialize the model container, setup inputs and outputs, and destroy the model container. Pull Request resolved: https://github.com/pytorch/pytorch/pull/110891 Approved by: https://github.com/chenyang78 ghstack dependencies: #110652 |
||
|---|---|---|
| .. | ||
| aoti_runtime | ||
| aoti_torch | ||
| aoti_model_runner_cuda.cpp | ||
| aoti_model_runner_cuda.h | ||
| aoti_model_runner.cpp | ||
| aoti_model_runner.h | ||
| inductor_ops.cpp | ||
| inductor_ops.h | ||