Driss Guessous cd6477617c Custom sdp implementations dense (#85984) ... # Summary - This code creates the runtime dispatch system for choosing a performant fused SDP kernel. The only choice of fused kernel is flash_attention. It also creates python flags and a context manager that can be used to turn off and on behavior for dispatch. - This also adds support for flash_attention with dense tensors. Pull Request resolved: https://github.com/pytorch/pytorch/pull/85984 Approved by: https://github.com/cpuhrsch		2022-10-03 17:36:37 +00:00
..
_static
_templates	Fix left nav (#78552)	2022-06-01 00:49:53 +00:00
community	[skip-ci] Fixed bad link in build_ci_governance.rst (#85933)	2022-10-03 17:35:44 +00:00
elastic	Add watchdog to TorchElastic agent and trainers (#84081)	2022-09-07 00:17:20 +00:00
notes	Added roundup_bypass_threshold_mb knobs to the PyTorch Caching Allocator (#85940)	2022-10-03 16:56:22 +00:00
rpc
scripts	[ONNX] Update ONNX documentation to include unsupported operators (#84496)	2022-09-16 23:48:37 +00:00
amp.rst	Remove deprecated torch.matrix_rank (#70981)	2022-09-22 17:40:46 +00:00
autograd.rst	Change torch.autograd.graph.disable_saved_tensors_hooks to be public API (#85994)	2022-10-03 16:25:01 +00:00
backends.rst	Custom sdp implementations dense (#85984)	2022-10-03 17:36:37 +00:00
benchmark_utils.rst
bottleneck.rst	add itt unit test and docstrings (#84848)	2022-09-28 01:39:58 +00:00
checkpoint.rst
complex_numbers.rst	Add a note on CUDA 11.6 (#80363)	2022-06-27 21:34:24 +00:00
conf.py	Add user facing documentation for CSAN (#84689)	2022-09-09 15:29:34 +00:00
config_mod.rst
cpp_extension.rst
cpp_index.rst
cuda._sanitizer.rst	Rework printing tensor aliases in CSAN error message (#85008)	2022-09-21 13:41:52 +00:00
cuda.rst	Add user facing documentation for CSAN (#84689)	2022-09-09 15:29:34 +00:00
cudnn_persistent_rnn.rst
cudnn_rnn_determinism.rst
data.rst	Extend collate function that can register collate functions to handle specific types (#85748)	2022-09-30 13:30:18 +00:00
ddp_comm_hooks.rst	Fix two small typos in ddp_comm_hooks.rst (#82047)	2022-07-23 19:10:57 +00:00
deploy.rst
distributed.algorithms.join.rst
distributed.elastic.rst
distributed.optim.rst
distributed.rst	[c10d] Start deprecating *_multigpu APIs (#85961)	2022-10-01 00:59:39 +00:00
distributions.rst
dlpack.rst
docutils.conf
fft.rst
fsdp.rst
futures.rst
fx.rst	CSE Pass and common pass Tests (#81742)	2022-07-22 03:45:09 +00:00
hub.rst
index.rst	Add torch.nested namespace (#84102)	2022-09-12 16:31:05 +00:00
jit_builtin_functions.rst
jit_language_reference_v2.rst	Fix typos in docs (#80602)	2022-08-29 23:32:44 +00:00
jit_language_reference.rst
jit_python_reference.rst
jit_unsupported.rst
jit_utils.rst	Create __init__.py (#78629)	2022-06-03 18:14:21 +00:00
jit.rst	torch.jit doc link for nvfuser readme.md (#77780)	2022-07-07 23:25:35 +00:00
library.rst	Add docs for Python Registration	2022-06-13 23:21:23 +00:00
linalg.rst	[Array API] Add linalg.vecdot (#70542)	2022-07-12 14:28:54 +00:00
masked.rst	[maskedtensor] first commit, core and creation (#82836)	2022-08-16 20:10:34 +00:00
math-quantizer-equation.png
mobile_optimizer.rst
model_zoo.rst
monitor.rst
multiprocessing.rst
name_inference.rst
named_tensor.rst	Add torch.unflatten and improve its docs (#81399)	2022-07-29 15:02:42 +00:00
nested.rst	Add python nested_tensor and as_nested_tensor constructors in torch.nested (#85593)	2022-09-28 20:15:02 +00:00
nn.functional.rst	Add Dropout1d module	2022-06-15 14:39:07 +00:00
nn.init.rst	update nn.init doc to reflect the no_grad (#80882)	2022-07-07 17:19:29 +00:00
nn.rst	Add Dropout1d module	2022-06-15 14:39:07 +00:00
onnx_supported_aten_ops.rst	[ONNX] Update ONNX documentation to include unsupported operators (#84496)	2022-09-16 23:48:37 +00:00
onnx.rst	[ONNX] Update user documentation (#85819)	2022-09-30 19:35:34 +00:00
optim.rst	feat: add PolynomialLR scheduler (#82769)	2022-08-10 18:21:00 +00:00
package.rst	Fix typos in torch.package documentation (#82994)	2022-08-08 20:19:17 +00:00
pipeline.rst
profiler.rst	add itt unit test and docstrings (#84848)	2022-09-28 01:39:58 +00:00
quantization-accuracy-debugging.rst
quantization-backend-configuration.rst
quantization-support.rst	Fix typo under docs directory and RELEASE.md (#85896)	2022-09-29 21:41:59 +00:00
quantization.rst	Fix typo under docs directory and RELEASE.md (#85896)	2022-09-29 21:41:59 +00:00
random.rst
rpc.rst	Fix typo under docs directory and RELEASE.md (#85896)	2022-09-29 21:41:59 +00:00
sparse.rst	Fix typo under docs directory and RELEASE.md (#85896)	2022-09-29 21:41:59 +00:00
special.rst	torch.special.scaled_modified_bessel_k0 (#78900)	2022-06-29 14:53:37 +00:00
storage.rst	Fix typos in docs (#80602)	2022-08-29 23:32:44 +00:00
tensor_attributes.rst	[docs] Add `torch.channels_last_3d (#85888)	2022-10-03 17:32:07 +00:00
tensor_view.rst
tensorboard.rst
tensors.rst	Remove deprecated torch.lstsq (#70980)	2022-09-23 00:16:55 +00:00
testing.rst	Fix links in torch.testing docs (#80353)	2022-07-11 19:15:53 +00:00
torch.ao.ns._numeric_suite_fx.rst
torch.ao.ns._numeric_suite.rst
torch.overrides.rst
torch.rst	Remove deprecated torch.lstsq (#70980)	2022-09-23 00:16:55 +00:00
type_info.rst