pytorch/test
Pieter Noordhuis 9b69da2b55 Allow for iterations where no module parameter is used (#19821)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/19821

It is possible that not a single parameter is used during an
iteration. If this is the case, the `prepare_for_backward` function
marks all parameters as unused, kicks off reduction of all buckets,
*and* finalizes the reduction.

This is different from the prior implementation where we assumed that
autograd would produce a gradient for at least a single parameter.
We then used the autograd callback mechanism to queue a finalizer
callback. Now, this finalizer may be executed in line.

Reviewed By: mrshenli

Differential Revision: D15113272

fbshipit-source-id: dc91458b569cd8c106ddaeea558464b515683550
2019-04-27 22:57:59 -07:00
..
bottleneck Implement torch.util.bottleneck (#5216) 2018-03-23 17:27:35 -04:00
cpp make QualifiedName a value type (#19626) 2019-04-27 16:13:24 -07:00
cpp_extensions Remove old complex Types (#19616) 2019-04-24 19:18:16 -07:00
custom_operator Create Object that represents a Module (#18469) 2019-04-05 18:58:52 -07:00
data Implement kthvalue in ATen (#17544) 2019-03-01 19:00:10 -08:00
error_messages [pep8] Fix most lint automatically with autopep8 2017-01-28 01:15:51 +01:00
expect Serialize first-class version of functions (#19723) 2019-04-25 15:53:07 -07:00
jit use fully qualified name for ScriptClasses (#19239) 2019-04-26 19:17:21 -07:00
onnx Removing unused arg f from _model_to_graph(). (#19647) 2019-04-26 09:40:52 -07:00
optim Turn on F401: Unused import warning. (#18598) 2019-03-30 09:01:17 -07:00
test_module Turn on F401: Unused import warning. (#18598) 2019-03-30 09:01:17 -07:00
common_cuda.py Revert replicate.py to disallow replicating multi-device modules (#19278) 2019-04-16 10:03:38 -07:00
common_methods_invocations.py Allow Tensor lists to show up in symbolic differentiable graphs. (#16784) 2019-04-10 18:16:20 -07:00
common_nn.py Turn on F401: Unused import warning. (#18598) 2019-03-30 09:01:17 -07:00
common_utils.py Remove no-fork workaround for running tests with ROCm (#19436) 2019-04-19 09:51:03 -07:00
expecttest.py Add support for inline expect tests. (#12825) 2018-10-22 19:29:04 -07:00
HowToWriteTestsUsingFileCheck.md Add a document 'How to Write Tests Using FileCheck' (#19005) 2019-04-08 12:12:30 -07:00
run_test.py TensorBoard support within PyTorch (#16196) 2019-04-25 21:30:23 -07:00
test_autograd.py Profiler: add Self CPU Time Total, CPU time total and other general improvements (#19378) 2019-04-25 20:53:55 -07:00
test_c10d.py Allow for iterations where no module parameter is used (#19821) 2019-04-27 22:57:59 -07:00
test_cpp_extensions.py Enable autograd to recognize the XLA backend as one providing multiple devices (#17847) 2019-03-20 13:58:36 -07:00
test_cuda_primary_ctx.py Lazily load libcuda libnvrtc from c++ (#17317) 2019-02-22 13:51:45 -08:00
test_cuda.py Add base support to torch.logspace, default base=10 (#19542) 2019-04-23 15:06:34 -07:00
test_dataloader.py fix typo: pytoch -> pytorch 2019-04-25 06:40:40 -07:00
test_distributed.py Fix BN tests for >= 8 GPU test environments (#19049) 2019-04-09 08:08:05 -07:00
test_distributions.py Enable unit tests for ROCm 2.3 (#19307) 2019-04-16 10:58:27 -07:00
test_docs_coverage.py Add torch.__config__.show(), reporting detailed version of all libraries. (#18579) 2019-04-09 11:13:24 -07:00
test_expecttest.py Add support for inline expect tests. (#12825) 2018-10-22 19:29:04 -07:00
test_fake_quant.py fix lint (#19632) 2019-04-23 15:29:38 -07:00
test_indexing_cuda.py Speed-up "advanced" indexing operations (#13420) 2018-11-27 15:23:59 -08:00
test_indexing.py Added indexing for bool tensors and bool Indices (#18583) 2019-04-03 12:47:26 -07:00
test_jit_fuser.py Make it possible for self.forward to return a ScriptMethod (#19217) 2019-04-24 11:14:34 -07:00
test_jit.py use fully qualified name for ScriptClasses (#19239) 2019-04-26 19:17:21 -07:00
test_mkldnn.py Add aten mkldnn linear operator 2019-04-26 13:41:57 -07:00
test_multiprocessing_spawn.py Binding for prctl(PR_SET_PDEATHSIG) (#14491) 2018-11-29 20:09:19 -08:00
test_multiprocessing.py fixes multiprocessing serialization for integer nn.Parameter (#18639) 2019-04-01 17:15:42 -07:00
test_namedtuple_return_api.py make test_jit_fuser runnable 2019-04-09 12:36:25 -07:00
test_nccl.py Shard all of tests based on how many tests exist. (#13160) 2018-10-26 18:20:34 -07:00
test_nn.py Make interpolate bicubic match opencv result (#19703) 2019-04-25 10:21:31 -07:00
test_numba_integration.py Fix Windows test CI 2019-03-13 09:22:46 -07:00
test_optim.py Revert D14577575: [pytorch][PR] Fix lack of state init for adagrad and add share_memory flag 2019-04-26 15:43:04 -07:00
test_quantized.py Quantized SumRelu (#19319) 2019-04-25 18:01:21 -07:00
test_quantizer.py Make Observer class as template Quant class for QuantConfig (#19418) 2019-04-19 21:47:54 -07:00
test_sparse.py Fix sparse mm for ROCm (#18985) 2019-04-07 18:16:16 -07:00
test_tensorboard.py TensorBoard support within PyTorch (#16196) 2019-04-25 21:30:23 -07:00
test_thd_distributed.py Turn on F401: Unused import warning. (#18598) 2019-03-30 09:01:17 -07:00
test_torch.py Add elementwise_affine for layer_norm_op (#19713) 2019-04-26 17:20:01 -07:00
test_type_hints.py Turn on F401: Unused import warning. (#18598) 2019-03-30 09:01:17 -07:00
test_type_info.py Allow converting char tensor to numpy; add [fi]info.min (#15046) 2018-12-24 09:11:24 -08:00
test_utils.py Remove unnecessary printing from tests 2019-04-23 09:24:08 -07:00