pytorch/test/cpp/jit
Dhruv Matani 755c60bffc [PyTorch Mobile] Allow loading of all extra files using the extra_file argument (#52635)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/52635

Currently, the method `_load_for_mobile()` accepts an extra files map named `extra_files` which serves as an in-out parameter. i.e. the call fills in the keys of this map with all files under the `extra/` folder that they wish to extract, and the method fills in the `extra_files` map with the contents of those files.

In a specific case we have encountered, it is desirable to extract all the extra files so that they can be forwarded in an opaque manner into a `save_for_mobile()` call with the same set of extra files as during load.

This change adds a method `_get_all_archive_file_names()` which returns the names of all files in the `.ptl` archive. The caller can then extract the ones within the `extra/` directory and pass them in to the `extra_files` map argument.

ghstack-source-id: 122356928

Test Plan: Added additional test + `buck test //xplat/caffe2:test_lite_interpreter`

Reviewed By: iseeyuan

Differential Revision: D26590027

fbshipit-source-id: 4dc30997929e132f319c32cb9435d8a40fe0db5e
2021-02-23 21:57:13 -08:00
..
__init__.py remediation of S205607 2020-07-17 17:19:47 -07:00
CMakeLists.txt [TorchScript] C++ interface of to_<backend> (Re-land) (#52340) 2021-02-17 07:17:50 -08:00
README.md port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_alias_analysis.cpp [codemod][fbcode/caffe2] Apply clang-format update fixes 2021-01-09 14:37:36 -08:00
test_argument_spec.cpp [codemod][fbcode/caffe2] Apply clang-format update fixes 2021-01-09 14:37:36 -08:00
test_autodiff.cpp Add inputs argument to autograd.backward() (#46855) 2020-11-02 14:32:38 -08:00
test_backend_lib.cpp Removes deprecated preprocess method from the backend interface (#52258) 2021-02-17 17:53:36 -08:00
test_backend.cpp [TorchScript] C++ interface of to_<backend> (Re-land) (#52340) 2021-02-17 07:17:50 -08:00
test_class_import.cpp gtest-ify JIT tests, through the letter c (#45249) 2020-09-24 00:21:20 -07:00
test_class_parser.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_class_type.cpp [JIT] Print out CU address in ClassType::repr_str() (#50194) 2021-01-19 23:04:30 -08:00
test_cleanup_passes.cpp gtest-ify JIT tests, through the letter c (#45249) 2020-09-24 00:21:20 -07:00
test_code_template.cpp gtest-ify JIT tests, through the letter c (#45249) 2020-09-24 00:21:20 -07:00
test_constant_pooling.cpp [JIT] Fix Dict bug in constant hashing (#45929) 2020-10-07 17:40:17 -07:00
test_create_autodiff_subgraphs.cpp gtest-ify JIT tests, through the letter c (#45249) 2020-09-24 00:21:20 -07:00
test_custom_class_registrations.cpp [JIT] Add support for default argument values to Torchbind (#51253) 2021-02-17 11:27:03 -08:00
test_custom_class_registrations.h gtest-ify JIT tests, through the letter c (#45249) 2020-09-24 00:21:20 -07:00
test_custom_class.cpp [TorchScript] Support user defined classes as constants (#5062) 2020-11-16 20:52:02 -08:00
test_custom_operators.cpp op_whitelist -> op_allowlist (#52150) 2021-02-22 12:23:42 -08:00
test_dce.cpp gtest-ify JIT tests, through the letter c (#45249) 2020-09-24 00:21:20 -07:00
test_fuser.cpp [Pytorch][Annotation] Update inlined callstack with module instance info (#47416) 2020-12-03 10:44:46 -08:00
test_gpu.cpp Fix wrong TORCH_CHECK usages (#52670) 2021-02-23 14:47:51 -08:00
test_graph_executor.cpp [JIT] Fix archive file extension in examples and docs (#50649) 2021-01-20 02:04:46 -08:00
test_inliner.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_interface.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_interpreter_async.pt [DI] Allow explicit taskLauncher for torchscript interpreter (#46865) 2020-11-04 17:07:55 -08:00
test_interpreter.cpp [JIT] Fix archive file extension in examples and docs (#50649) 2021-01-20 02:04:46 -08:00
test_ir.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_irparser.cpp Fix stride printing/parsing formatting (#45156) 2020-10-06 15:06:46 -07:00
test_jit_type.cpp [PyTorch][codemod] Replace immediately-dereferenced expect calls w/expectRef (#50228) 2021-01-13 16:13:55 -08:00
test_lite_interpreter.cpp [PyTorch Mobile] Allow loading of all extra files using the extra_file argument (#52635) 2021-02-23 21:57:13 -08:00
test_lite_trainer.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_memory_dag.cpp [jit] gtest-ify test_alias_analysis.cpp (#45018) 2020-09-21 12:19:37 -07:00
test_misc.cpp Improve PyTorch profiler flop computation formulas (#51377) 2021-02-02 11:49:04 -08:00
test_mobile_type_parser.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_module_api.cpp [JIT] Update freezing api (#52337) 2021-02-18 00:17:27 -08:00
test_peephole_optimize.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_qualified_name.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_save_load.cpp Adding JIT support for cuda streams and events (#48020) 2020-12-29 20:24:57 -08:00
test_schema_matching.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_subgraph_matcher.cpp [JIT] Support multiple outputs in subgraph matcher. (#48992) 2020-12-15 13:09:24 -08:00
test_subgraph_rewriter.cpp [JIT] Support multiple outputs in subgraph matcher. (#48992) 2020-12-15 13:09:24 -08:00
test_subgraph_utils.cpp [JIT] SubgraphUtils: add a function for generating a string name for a given graph. (#47253) 2020-11-03 16:36:41 -08:00
test_utils.cpp port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
test_utils.h port all JIT tests to gtest (#45264) 2020-09-25 11:37:43 -07:00
tests_setup.py Adding JIT support for cuda streams and events (#48020) 2020-12-29 20:24:57 -08:00
torch_python_test.cpp [jit] Pull (most) tests out of libtorch_python (#44795) 2020-09-18 14:04:40 -07:00

JIT C++ Tests

Adding a new test

First, create a new test file. Test files should have be placed in this directory, with a name that starts with test_, like test_foo.cpp.

In general a single test suite

Add your test file to the JIT_TEST_SRCS list in test/cpp/jit/CMakeLists.txt.

A test file may look like:

#include <gtest/gtest.h>

using namespace ::torch::jit

TEST(FooTest, BarBaz) {
   // ...
}

// Append '_CUDA' to the test case name will automatically filter it out if CUDA
// is not compiled.
TEST(FooTest, NeedsAGpu_CUDA) {
   // ...
}

// Similarly, if only one GPU is detected, tests with `_MultiCUDA` at the end
// will not be run.
TEST(FooTest, NeedsMultipleGpus_MultiCUDA) {
   // ...
}

Building and running the tests

The following commands assume you are in PyTorch root.

# ... Build PyTorch from source, e.g.
python setup.py develop
# (re)build just the binary
ninja -C build bin/test_jit
# run tests
build/bin/test_jit --gtest_filter='glob_style_filter*'