pytorch/torch/backends
Peter Goldsborough 9ce15173fb Move _cudnn_init_dropout_state to TensorOptions and enable cuDNN dropout in C++ API RNNs (#9012)
Summary:
The goal of this PR was to add support for dropout descriptors in the C++ API's RNN class.
The end result is a 4x-5x speedup for our RNN integration tests since they can now use cuDNN instead of autograd when dropout is set.

To achieve this, I had to move `_cudnn_init_dropout_state` to the `TensorOptions` API.

I also fixed a bug around `RNN::cuda()` not flattening parameters for cuDNN.

ebetica ezyang
Closes https://github.com/pytorch/pytorch/pull/9012

Reviewed By: pjh5

Differential Revision: D8689786

Pulled By: goldsborough

fbshipit-source-id: 44fb191f5a38e41c4ded5417306b5bbc012cd56c
2018-06-29 17:25:23 -07:00
..
cuda Cache cufft plans (#8344) 2018-06-22 13:02:34 -04:00
cudnn Move _cudnn_init_dropout_state to TensorOptions and enable cuDNN dropout in C++ API RNNs (#9012) 2018-06-29 17:25:23 -07:00
mkl [fft][1 of 3] build system and helpers to support cuFFT and MKL (#5855) 2018-03-19 15:43:14 -04:00
__init__.py Add cuDNN support for convolutions (#36) 2016-09-27 17:55:04 -04:00