pytorch/test/cpp/jit
Martin Yuan ccf4d69b75 [Lite Interpreter] Enable __setstate__ (#33294)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/33294

1. Serialize bytecode of __setstate__ and run it when loading the model.
2. One use case is quantization. To test this use case a few operators are registered temporarily for lite interpreter. The "_" prefix registration will be removed when the operators are all migrated to mobile.

Test Plan: Imported from OSS

Differential Revision: D20162898

Pulled By: iseeyuan

fbshipit-source-id: 7a3180807bf38fbce594d86993896861f12bb58c
2020-03-05 15:24:21 -08:00
..
__init__.py Add train() / eval() / is_training() to C++ ScriptModule API (#16044) 2019-02-01 13:07:38 -08:00
CMakeLists.txt Enable jit fusion on ROCm (#22872) 2019-09-05 18:22:08 -07:00
gtest.cpp big cpp test reorg (#24801) 2019-08-18 16:49:56 -07:00
README.md big cpp test reorg (#24801) 2019-08-18 16:49:56 -07:00
test_alias_analysis.cpp [JIT] Introduce a fake Tensor creation node for IR unit tests (#33914) 2020-03-05 12:42:42 -08:00
test_argument_spec.cpp [jit] do the code reorg (#33851) 2020-02-27 13:02:51 -08:00
test_autodiff.cpp [jit] do the code reorg (#33851) 2020-02-27 13:02:51 -08:00
test_base.cpp [JIT] Introduce a fake Tensor creation node for IR unit tests (#33914) 2020-03-05 12:42:42 -08:00
test_base.h [jit] do the code reorg (#33851) 2020-02-27 13:02:51 -08:00
test_class_import.cpp [jit] do the code reorg (#33851) 2020-02-27 13:02:51 -08:00
test_class_parser.cpp [jit] do the code reorg (#33851) 2020-02-27 13:02:51 -08:00
test_class_type.cpp [jit][fix] Remove slot in parameter slot (#32846) 2020-02-19 11:15:15 -08:00
test_code_template.cpp [jit] do the code reorg (#33851) 2020-02-27 13:02:51 -08:00
test_constant_pooling.cpp [jit] do the code reorg (#33851) 2020-02-27 13:02:51 -08:00
test_create_autodiff_subgraphs.cpp big cpp test reorg (#24801) 2019-08-18 16:49:56 -07:00
test_custom_class.cpp [JIT] Trace uses of torchbind classes as module attributes (#32833) 2020-02-04 19:28:37 -08:00
test_custom_operators.cpp [jit] do the code reorg (#33851) 2020-02-27 13:02:51 -08:00
test_dce.cpp [JIT] Introduce a fake Tensor creation node for IR unit tests (#33914) 2020-03-05 12:42:42 -08:00
test_fuser.cpp [jit] do the code reorg (#33851) 2020-02-27 13:02:51 -08:00
test_graph_executor.cpp improved TorchScript traceback (#33834) 2020-03-03 12:27:38 -08:00
test_inliner.cpp [jit] do the code reorg (#33851) 2020-02-27 13:02:51 -08:00
test_interface.cpp [jit] do the code reorg (#33851) 2020-02-27 13:02:51 -08:00
test_interpreter.cpp improved TorchScript traceback (#33834) 2020-03-03 12:27:38 -08:00
test_ir.cpp [jit] do the code reorg (#33851) 2020-02-27 13:02:51 -08:00
test_irparser.cpp [jit] do the code reorg (#33851) 2020-02-27 13:02:51 -08:00
test_ivalue.cpp Remove dead includes in caffe2/test 2020-01-21 11:30:34 -08:00
test_jit_type.cpp [jit] do the code reorg (#33851) 2020-02-27 13:02:51 -08:00
test_lite_interpreter.cpp [Lite Interpreter] Enable __setstate__ (#33294) 2020-03-05 15:24:21 -08:00
test_misc.cpp improved TorchScript traceback (#33834) 2020-03-03 12:27:38 -08:00
test_mobile_type_parser.cpp JIT Type parser for mobile (#30391) 2019-12-14 20:29:42 -08:00
test_module_api.cpp [jit] Add None parameter as parameter instead of attributes (#32964) 2020-02-19 16:06:56 -08:00
test_netdef_converter.cpp big cpp test reorg (#24801) 2019-08-18 16:49:56 -07:00
test_peephole_optimize.cpp [jit] do the code reorg (#33851) 2020-02-27 13:02:51 -08:00
test_qualified_name.cpp big cpp test reorg (#24801) 2019-08-18 16:49:56 -07:00
test_save_load.cpp [jit] Add type tags to lists/dicts in pickle (#33255) 2020-03-03 16:48:21 -08:00
test_schema_matching.cpp [jit] do the code reorg (#33851) 2020-02-27 13:02:51 -08:00
test_subgraph_matcher.cpp [jit] do the code reorg (#33851) 2020-02-27 13:02:51 -08:00
test_subgraph_rewriter.cpp [jit] do the code reorg (#33851) 2020-02-27 13:02:51 -08:00
test_subgraph_utils.cpp big cpp test reorg (#24801) 2019-08-18 16:49:56 -07:00
test_utils.cpp improved TorchScript traceback (#33834) 2020-03-03 12:27:38 -08:00
test_utils.h [jit] do the code reorg (#33851) 2020-02-27 13:02:51 -08:00
tests_setup.py Better error for torch::jit::loading a eager file (#31709) 2020-01-07 16:20:42 -08:00
tests.h [Lite Interpreter] Enable __setstate__ (#33294) 2020-03-05 15:24:21 -08:00
torch_python_test.cpp Better error for torch::jit::loading a eager file (#31709) 2020-01-07 16:20:42 -08:00

JIT C++ Tests

How to add a new test

First, create a new test file. Test files should have be placed in this directory, with a name that starts with test_, like test_foo.cpp.

Here is an example test file you can copy-paste.

#include <test/cpp/jit/test_base.h>

// Tests go in torch::jit
namespace torch {
namespace jit {

// 1. Test cases are void() functions.
// 2. They start with the prefix `test`
void testCaseOne() {
    // ...
}

void testCaseTwo() {
    // ...
}
}
}

Then, register your test in tests.h:

// Add to TH_FORALL_TESTS_CUDA instead for CUDA-requiring tests
#define TH_FORALL_TESTS(_)             \
  _(ADFormulas)                        \
  _(Attributes)                        \
  ...
  _(CaseOne)  // note that the `test` prefix is omitted.
  _(CaseTwo)

We glob all the test files together in CMakeLists.txt so that you don't have to edit it every time you add a test. Unfortunately, this means that in order to get the build to pick up your new test file, you need to re-run cmake:

python setup.py build --cmake

Why do we have two different test runners?

We have two different ways of running our cpp tests:

  1. With gtest, from a standalone binary.
  2. With Python, from TestJit.test_cpp and TestJit.test_cpp_cuda (in test/test_jit.py)

We want both because we need to test things from a pure-C++ environment and with all our various Python patch-points enabled.

How do I run the tests?

The following commands assume you are in PyTorch root.

  1. With gtest:
    # (re)build the test binary
    ninja build/bin/test_jit
    # run
    build/bin/test_jit --gtest_filter='glob_style_filter*'
    
  2. With Python:
    python test/test_jit.py TestJit.test_cpp TestJit.test_cpp_cuda