mirror of
https://github.com/zebrajr/pytorch.git
synced 2025-12-08 07:39:33 +01:00
60a45eb862
Summary: We used RAIIAtenTensorHandle for ConstantMap, where RAIIAtenTensorHandle is a unique_ptr, indicating that all memory handling is by the AOTInductor internally. In this PR, we introduce ConstantAtenTensorHandle which replaces RAIIATenTensorHandle. This class holds a raw AtenTensorHandle, and also owns a RAIIAtenTensorHandle if user decides to delegate memory management to AOTInductor. This is a prerequisite for user managed buffer, this PR, however only introduces this class and make sure it works with existing AOTInductor and has the default behavior identical as using RAIIAtenTensorHandle. Test Plan: Existing tests. No change should be introduced within this PR. Reviewers: Subscribers: Tasks: Tags: Pull Request resolved: https://github.com/pytorch/pytorch/pull/150275 Approved by: https://github.com/chenyang78, https://github.com/desertfire |
||
|---|---|---|
| .. | ||
| aoti_eager | ||
| aoti_include | ||
| aoti_package | ||
| aoti_runner | ||
| aoti_runtime | ||
| aoti_torch | ||
| cpp_wrapper | ||
| array_ref_impl.h | ||
| inductor_ops.cpp | ||
| inductor_ops.h | ||
| resize_storage_bytes.cpp | ||
| static_cuda_launcher.cpp | ||
| static_cuda_launcher.h | ||