Bram Vanroy
38d68ad803
Update randomness.rst ( #21337 )
...
Summary:
Following [this question on the forums](https://discuss.pytorch.org/t/reproducibility-and-performance/46504 ), I propose the following doc change. It clarifies that 'performance reduction' concerns the processing speed (and not the training accuracy).
Related website commit: https://github.com/pytorch/pytorch.github.io/pull/211
Pull Request resolved: https://github.com/pytorch/pytorch/pull/21337
Differential Revision: D15622151
Pulled By: soumith
fbshipit-source-id: f0edeb20049f2ee715c400e7c57abb966864d621
2019-06-04 07:38:00 -07:00
Tongzhou Wang
bb89827e1d
Update cuda pinned memory note to include tensor.to ( #20977 )
...
Summary:
separate bits of changes from #19228
Pull Request resolved: https://github.com/pytorch/pytorch/pull/20977
Differential Revision: D15511919
Pulled By: soumith
fbshipit-source-id: 5015a29cdac6d6e160388c493182c330f0da63ec
2019-05-26 22:22:06 -07:00
Tongzhou Wang
83fe92870d
Update multiprocessing note now that shared CUDA tensors are refcounted ( #19904 )
...
Summary:
The mp notes are not updated after https://github.com/pytorch/pytorch/pull/16854 . (The torch.multiprocessing page is.)
Pull Request resolved: https://github.com/pytorch/pytorch/pull/19904
Differential Revision: D15509661
Pulled By: soumith
fbshipit-source-id: 7c11e14a6c804498dda3adbf19710e63e6a564a0
2019-05-25 17:40:42 -07:00
Sergii Dymchenko
a5c90aaf47
Use "length of the RNN input" instead of "length of the RNN"
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/20873
Differential Revision: D15495570
Pulled By: ezyang
fbshipit-source-id: e3b4cd67ccf97d0053ac053c3bcb74415b928c0a
2019-05-24 09:03:50 -07:00
peter
39b885cbbf
Add magma for CUDA 10.1 to Windows docs
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/19914
Differential Revision: D15123029
Pulled By: soumith
fbshipit-source-id: a3d4b498a763e1a9829896d44211be00400ec39d
2019-04-29 10:13:21 -07:00
Tongzhou Wang
6d307db5b4
Move cuFFT plan cache note outside Best Practices ( #19538 )
...
Summary:
I mistakenly put it there.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/19538
Differential Revision: D15026500
Pulled By: soumith
fbshipit-source-id: 0c13499571fdfd789c3bd1c4b58abd870725d422
2019-04-20 21:39:59 -07:00
Tongzhou Wang
973d51079b
Add device-specific cuFFT plan caches ( #19300 )
...
Summary:
Fixes https://github.com/pytorch/pytorch/issues/19224
Pull Request resolved: https://github.com/pytorch/pytorch/pull/19300
Differential Revision: D14986967
Pulled By: soumith
fbshipit-source-id: 8c31237db50d6924bba1472434c10326610d9255
2019-04-18 06:39:35 -07:00
Edward Yang
48a35135fb
Convert all tabs to spaces, add CI. ( #18959 )
...
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/18959
ghimport-source-id: a934163fa34cb2019732d5f49dc7290c376bf156
Differential Revision: D14831246
Pulled By: ezyang
fbshipit-source-id: beb92dc4ee8c82f4c8259c081dd72e477fe7a9d0
2019-04-09 08:12:26 -07:00
peter
9af6564060
Add magma debug version for Windows
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/18008
Differential Revision: D14455117
Pulled By: soumith
fbshipit-source-id: 29d9a2e0b36d72bece0bb1870bbdc740c4d1f9d6
2019-03-14 10:15:57 -07:00
Tongzhou Wang
b6313d74e1
fix faq typo
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/17851
Differential Revision: D14401791
Pulled By: soumith
fbshipit-source-id: ed6d64d6f5985e7ce76dca1e9e376782736b90f9
2019-03-10 15:33:52 -07:00
peter
c78da0c6ed
Enable using CMD when building cpp extensions on Windows
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/17706
Differential Revision: D14346482
Pulled By: ezyang
fbshipit-source-id: 7c85e51c701f6c0947ad324ef19fafda40ae1cb9
2019-03-06 14:45:31 -08:00
peter
81f2bdf9c2
Update magma to 2.5.0 for Windows
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/17607
Differential Revision: D14281291
Pulled By: yf225
fbshipit-source-id: 51209c5540932871e45e54ba6d61b3b7d264aa8c
2019-03-01 09:53:56 -08:00
SsnL
300dcc3b96
Add cuda.reset_max_memory_* ( #15985 )
...
Summary:
Addresses #15968
Pull Request resolved: https://github.com/pytorch/pytorch/pull/15985
Differential Revision: D13649916
Pulled By: soumith
fbshipit-source-id: a207aea5709a79dba7a6fc541d0a70103f49efff
2019-01-14 07:31:51 -08:00
Alexander Rodin
a0d22b6965
Fix typo in documentation
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/15628
Differential Revision: D13562685
Pulled By: soumith
fbshipit-source-id: 1621fcff465b029142313f717035e935e9159513
2018-12-30 18:07:57 -08:00
peterjc123
e1eb32d9f1
Update magma to 2.4.0 for Windows
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/14738
Differential Revision: D13341611
Pulled By: soumith
fbshipit-source-id: 39a49fc60e710cc32a463858c9cee57c182330e2
2018-12-05 09:53:39 -08:00
Tongzhou Wang
8a35aafca6
Try to fix randomness.rst formatting again
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/12853
Differential Revision: D10458439
Pulled By: SsnL
fbshipit-source-id: ebd259e598327b0c5d63de6b7c182781fe361fbd
2018-10-18 19:18:49 -07:00
Tongzhou Wang
a85174b46a
Fix randomness.rst formatting
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/12850
Differential Revision: D10457694
Pulled By: SsnL
fbshipit-source-id: fa64964ff6d41625d9383ca96393017230e4ee0f
2018-10-18 18:26:26 -07:00
Thomas Viehmann
0521c47c91
Amend nondeterminism notes ( #12217 )
...
Summary:
include atomicAdd commentary as this is less well known
There is some discussion in #12207
Unfortunately, I cannot seem to get the ..include working in `_tensor_docs.py` and `_torch_docs.py`. I could use a hint for that.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/12217
Differential Revision: D10419739
Pulled By: SsnL
fbshipit-source-id: eecd04fb7486bd9c6ee64cd34859d61a0a97ec4e
2018-10-16 23:59:26 -07:00
cclauss
b0248df72a
Docs: Change cuda(async) —> cuda(non_blocking) ( #12158 )
...
Summary:
goldsborough Modify the docs to match the changes made in #4999
Pull Request resolved: https://github.com/pytorch/pytorch/pull/12158
Differential Revision: D10103964
Pulled By: SsnL
fbshipit-source-id: 1b8692da86aca1a52e8d2e6cea76a5ad1f71e058
2018-09-28 08:39:27 -07:00
Tongzhou Wang
c30790797f
Minor data loader doc improvements
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/11821
Differential Revision: D9948292
Pulled By: SsnL
fbshipit-source-id: 01c21c129423c0f7844b403e665a8fe021a9c820
2018-09-19 15:33:25 -07:00
Rasmus Diederichsen
6fc18a7541
Typo fix in randomness.rst ( #11571 )
...
Summary:
"need to be" -> "need not be"
Pull Request resolved: https://github.com/pytorch/pytorch/pull/11571
Differential Revision: D9786001
Pulled By: soumith
fbshipit-source-id: 7cc408f5c8bfcc56d4b5c153646f30e1cec37539
2018-09-12 08:25:46 -07:00
Rasmus Diederichsen
8aa8ad8b01
WIP: Reproducibility note ( #11329 )
...
Summary:
This adds a Note on making experiments reproducible.
It also adds Instructions for building the Documentation to `README.md`. Please ping if I missed any requirements.
I'm not sure what to do about the submodule changes. Please advise.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/11329
Differential Revision: D9784939
Pulled By: ezyang
fbshipit-source-id: 5c5acbe343d1fffb15bdcb84c6d8d925c2ffcc5e
2018-09-11 21:09:51 -07:00
Thomas Viehmann
3799b10c44
various documentation formatting ( #9359 )
...
Summary:
This is a grab-bag of documentation formatting fixes.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/9359
Differential Revision: D8831400
Pulled By: soumith
fbshipit-source-id: 8dac02303168b2ea365e23938ee528d8e8c9f9b7
2018-07-13 02:48:25 -07:00
Tongzhou Wang
e8536c08a1
Update extension docs, fix Fold/Unfold docs ( #9239 )
...
Summary:
Commits:
1. In extension doc, get rid of all references of `Variable` s (Closes #6947 )
+ also add minor improvements
+ also added a section with links to cpp extension :) goldsborough
+ removed mentions of `autograd.Function.requires_grad` as it's not used anywhere and hardcoded to `return_Py_True`.
2. Fix several sphinx warnings
3. Change `*` in equations in `module/conv.py` to `\times`
4. Fix docs for `Fold` and `Unfold`.
+ Added better shape check for `Fold` (it previously may give bogus result when there are not enough blocks). Added test for the checks.
5. Fix doc saying `trtrs` not available for CUDA (#9247 )
Pull Request resolved: https://github.com/pytorch/pytorch/pull/9239
Reviewed By: soumith
Differential Revision: D8762492
Pulled By: SsnL
fbshipit-source-id: 13cd91128981a94493d5efdf250c40465f84346a
2018-07-08 19:09:39 -07:00
Richard Zou
b4cd9f2fc9
Clarify mp note about sharing a tensor's grad field. ( #8688 )
...
* Clarify mp note about sharing a tensor's grad field.
* Address comments
* Address comments
2018-06-20 14:22:38 -04:00
Kaiyu Shi
0169ac5936
Fix sample code for cuda stream ( #8319 )
2018-06-10 11:41:50 -04:00
Tongzhou Wang
9af3a80cff
Docs for gradcheck and gradgradcheck; expose gradgradcheck ( #8166 )
...
* Docs for gradcheck and gradgradcheck; expose gradgradcheck
* address comments
2018-06-06 13:59:55 -04:00
peterjc123
108fb1c2c9
Fix the import part of the windows doc ( #7979 )
2018-05-30 21:51:30 -04:00
peterjc123
267fc43a96
Fix Windows doc for import error ( #7704 )
...
* Fix Windows doc for import error
* Fix doc again
* Fix wrong format
2018-05-29 22:07:00 +01:00
braincodercn
5ee5537b98
Fix typo in document ( #7725 )
2018-05-21 11:10:24 -04:00
Richard Zou
0430bfe40b
[docs] Update broadcasting and cuda semantics notes ( #6904 )
...
* [docs] Update broadcasting and cuda semantics notes
* Update multiprocessing.rst
* address comments
* Address comments
2018-04-24 13:41:24 -04:00
peterjc123
a4dbd37403
[doc] Minor fixes for Windows docs ( #6853 )
2018-04-23 13:15:33 +02:00
peterjc123
56567fe47d
Add documents for Windows ( #6653 )
...
* Add Windows doc
* some minor fixes
* Fix typo
* more minor fixes
* Fixes on dataloader
2018-04-22 15:18:02 -04:00
Richard Zou
2acc247517
[docs] Update autograd notes ( #6769 )
2018-04-19 13:34:14 -04:00
Tongzhou Wang
6b7ec95abb
Link relevant FAQ section in DataLoader docs ( #6476 )
...
* Link FAQ section on workers returning same random numbers in DataLoader docs
* explicitly mention section names
2018-04-11 13:41:46 -04:00
Tongzhou Wang
4d15442ebc
Add total_length option to pad_packed_sequence ( #6327 )
...
* add total_length to pad_packed_sequence; add example on how to use pack->rnn->unpack with DP
* address comments
* fix typo
2018-04-08 20:25:48 -04:00
Kento NOZAWA
c00ee6da8f
Fix typos ( #6348 )
...
* Fix typo
* Fix typo
* Update faq.rst
2018-04-06 11:06:42 -04:00
Kaiyu Shi
605307f8f3
Add support for printing extra information in Module and refactor redundant codes ( #5936 )
...
This PR enables users to print extra information of their subclassed nn.Module.
Now I simply insert the user-defined string at the ending of module name, which should be discussed in this PR.
Before this PR, users should redefine the __repr__ and copy&paste the source code from Module.
* Add support for extra information on Module
* Rewrite the repr method of Module
* Fix flake8
* Change the __repr__ to get_extra_repr in Linear
* Fix extra new-line for empty line
* Add test for __repr__ method
* Fix bug of block string indent
* Add indent for multi-line repr test.
* Address review comments
* Update tutorial for creating nn.Module
* Fix flake8, add extra_repr of bilinear
* Refactor DropoutNd
* Change to extra_repr in some Modules
* Fix flake8
* Refactor padding modules
* Refactor pooling module
* Fix typo
* Change to extra_repr
* Fix bug for GroupNorm
* Fix bug for LayerNorm
2018-04-02 13:52:33 -04:00
Peter Goldsborough
47f31cb1e6
Update FAQ to make more sense after tensor/variable merge ( #6017 )
2018-03-27 07:48:25 -07:00
Richard Zou
5d628db0a2
Deprecate ctx.saved_variables via python warning. ( #5923 )
...
* Deprecate ctx.saved_variables via python warning.
Advises replacing saved_variables with saved_tensors.
Also replaces all instances of ctx.saved_variables with ctx.saved_tensors in the
codebase.
Test by running:
```
import torch
from torch.autograd import Function
class MyFunction(Function):
@staticmethod
def forward(ctx, tensor1, tensor2):
ctx.save_for_backward(tensor1, tensor2)
return tensor1 + tensor2
@staticmethod
def backward(ctx, grad_output):
var1, var2 = ctx.saved_variables
return (grad_output, grad_output)
x = torch.randn((3, 3), requires_grad=True)
y = torch.randn((3, 3), requires_grad=True)
model = MyFunction()
model.apply(x, y).sum().backward()
```
and assert the warning shows up.
* Address comments
* Add deprecation test for saved_variables
2018-03-26 14:13:45 -04:00
Tongzhou Wang
00cc962670
typo ( #5847 )
2018-03-17 10:26:00 -04:00
Tongzhou Wang
392fc8885c
add faq on cuda memory management and dataloder ( #5378 )
2018-02-27 18:35:30 -05:00
Tongzhou Wang
8c18220a59
Fix layer_norm initialization and nn.Module docs ( #5422 )
...
* Fix LN initialization; Support single int normalized_shape
* disable docstring inheritance
* fix sphinx warnings
2018-02-26 19:32:08 -05:00
Junior Rojas
642e4d0762
Fix typos ( #5340 )
2018-02-21 16:27:12 -05:00
brett koonce
596470011b
minor sp, underlyhing->underlying ( #5304 )
2018-02-19 22:28:17 -05:00
Edward Z. Yang
e411525f2c
Add a FAQ, for now just 'out of memory' advice. ( #5251 )
...
* Add a FAQ, for now just 'out of memory' advice.
Signed-off-by: Edward Z. Yang <ezyang@fb.com>
* Updates based on comments.
Signed-off-by: Edward Z. Yang <ezyang@fb.com>
* minor copyedit
2018-02-15 17:38:55 -08:00
Thibault FEVRY
e39e86f119
Remove deprecated references to volatile ( #5193 )
2018-02-12 21:08:27 +01:00
Peter Goldsborough
65353f1342
Remove volatile section from autograd notes
2018-02-01 00:26:36 +01:00
Tongzhou Wang
6420c6b224
Improve torch.cuda.empty_cache documentation ( #4879 )
...
* add doc about empty_cache wont increase amount of memory available
* typo
2018-01-27 04:54:25 -05:00
Yongjik Kim
dd5c195646
More documentation for CUDA stream functions. ( #4756 )
2018-01-21 12:58:51 +01:00
Tongzhou Wang
5918243b0c
Methods for checking CUDA memory usage ( #4511 )
...
* gpu mem allocated
* add test
* addressed some of @apaszke 's comments
* cache stats
* add more comments about test
2018-01-09 11:47:48 -05:00
SsnL
bb1b826cdc
Exposing emptyCache from allocator ( #3518 )
...
* Add empty_cache binding
* cuda.empty_cache document
* update docs
2017-11-07 17:00:38 -05:00
Kaixhin
5de7f9e731
Tidy up CUDA notes
2017-11-05 14:42:06 +01:00
Kai Arulkumaran
a7c5be1d45
Document CUDA best practices ( #3227 )
2017-10-25 22:38:17 +02:00
Sang-gil Lee
42448cf07f
Fix to make the sample code executable as-is in "Extending PyTorch" ( #2621 )
2017-09-05 10:19:49 -04:00
Gabriel Bianconi
cdae579c22
Fix typos in "Extending PyTorch" ( #2558 )
2017-08-29 09:39:29 -04:00
Soumith Chintala
b079469af0
self -> ctx in Extending note
2017-08-25 07:19:20 -04:00
Adam Paszke
4599c0c7df
Update autograd notes ( #2295 )
2017-08-05 05:18:05 +05:30
ngimel
66bbe5d75a
.creator -> .grad_fn in the code example ( #2171 )
2017-07-21 14:43:16 -04:00
brett koonce
16dd997239
Spelling tweaks for documentation ( #2114 )
2017-07-15 13:16:32 -07:00
yunjey
52a9367fa7
Fix minor typo ( #2100 )
...
Fixed minor typo in Autograd mechanics docs.
2017-07-14 10:20:13 -04:00
Hungryof
73128f7b08
fix minor typos ( #2051 )
...
* Update extending.rst
fix typo
* Update cuda.rst
fix typo
2017-07-11 11:01:41 -04:00
Soumith Chintala
ee1b7b50b3
fix docs for broadcast warning
2017-06-26 14:50:57 -04:00
Sam Gross
9c53c6dcb9
Fix errors and warnings when building docs ( #1806 )
2017-06-14 13:50:14 -04:00
Gregory Chanan
1ef4cc1591
Incorporate review comments:
...
1) Line up trailing dimensions in broadcast docs.
2) remove unnecessary expand_as in common_nn test.
3) use view in tensor_str instead of resize_.
4) newExpand remove raiseErrors change.
5) clarify expandedSizes/expandedStrides parameters in inferExpandGeometry.
6) simplify inferSize2/inferSizeN implementations.
7) use new-style classes for warning.
2017-06-11 05:37:59 -04:00
Gregory Chanan
deec86cc05
Clarify a number of comments.
2017-06-11 05:37:59 -04:00
Gregory Chanan
5e1a714386
Add backwards incompatibility docs.
2017-06-11 05:37:59 -04:00
Gregory Chanan
cd35091d9b
Include simple broadcasting example and demonstrate lining up trailing dimensions.
2017-06-11 05:37:59 -04:00
Gregory Chanan
471dfe9791
Add documentation including links to numpy broadcasting semantics.
2017-06-11 05:37:59 -04:00
Bubble
2ce5875a4d
Modify the sample code of extending autograd ( #1720 )
...
The original input can not be used as input of Linear(), because forward() takes at least 3 arguments (2 given)
2017-06-05 23:36:58 -04:00
Bubble
447fe953e5
Modify the sample code of volatile ( #1694 )
...
The original two inputs (torch.randn(5,5)) can not be used as input of resnet, which must be (batch, channels, width, height)
2017-06-01 09:46:04 -04:00
Edward Z. Yang
2f4bf4ab39
Rewrite 'How autograd encodes the history' to accurately describe current setup. ( #1580 )
...
Signed-off-by: Edward Z. Yang <ezyang@fb.com>
2017-05-17 19:21:20 -04:00
Soumith Chintala
aa506fa4d7
fix docs typo
2017-04-05 23:42:02 -04:00
Du Phan
86e40ed875
Fix a typo in docs about pinned memory buffers ( #1023 )
...
* remove misleading guide for BCELoss
* fix docs about pinned memory buffers
2017-03-17 05:08:03 -04:00
Jonathan Tremblay
9004652c7b
updated the documentation to remove the unnecessary copy grads when using multiprocessing
2017-03-13 19:04:17 -04:00
Alexis David Jacq
2b1cd919ce
Update extending.rst ( #933 )
2017-03-06 23:23:14 -05:00
Li Dong
761d6799be
code syntax error in document (serialization.rst) ( #937 )
2017-03-06 10:06:04 -05:00
Yiran Mao
7d58765cee
docs: Fixed example code bug in extending module doc.
2017-03-05 12:09:08 -05:00
Eli Stevens
88275da5e8
CUDA documentation tweaks ( #858 )
2017-02-26 20:37:43 +01:00
Eli Stevens
b87c113cf4
CUDA documentation enhancement and docs versioning ( #848 )
...
* Add more detail to CUDA documentation
Also adds better cross-linking to the pages that discuss relevant topics.
* Adds recommendation to torch.save docs
* Make the version numbers for the docs dynamic
Might need tweaks for beta, 1.0, etc.
2017-02-26 08:33:26 -05:00
Alfredo Canziani
ec4602a973
Fix bad code alignment ( #612 )
...
forward *is* a method of the Linear class
2017-01-27 20:16:49 +01:00
Alfredo Canziani
a38749d15f
Fix cuda notes
...
Target GPU *is* consisten with source GPU
2017-01-27 19:30:49 +01:00
Sheng Zhang
c28575a4eb
Fix typo in documentation for autograd
2017-01-20 21:59:33 +01:00
Adam Paszke
4cc11066b2
Add torch.utils.data docs and improve notes ( #460 )
...
* Add torch.utils.data docs and improve notes
2017-01-17 14:51:05 -05:00
Adam Paszke
15c1dad340
Minor fixes and torch.cuda docs
2017-01-16 20:38:14 -05:00
Adam Paszke
7ced682ff5
Add notes
2017-01-16 20:38:14 -05:00