pytorch/torch/csrc/jit/codegen/cuda
soulitzer 4cdfceddd2 [Reland] Avoid saving self for softmax and log_softmax (#66018)
Summary:
Reland of https://github.com/pytorch/pytorch/pull/65242

The last attempt of the reland automatically rebased onto stable, which did not yet have the revert commit

Pull Request resolved: https://github.com/pytorch/pytorch/pull/66018

Reviewed By: albanD

Differential Revision: D31348822

Pulled By: soulitzer

fbshipit-source-id: 881d701b404530c1352ac9245bd67264e1652b8a
2021-10-03 21:35:01 -07:00
..
docs [nvFuser] Latency improvements for pointwise + reduction fusion (#45218) 2020-09-24 23:17:20 -07:00
ops [AutoAccept][Codemod][FBSourceClangFormatLinter] Daily arc lint --take CLANGFORMAT 2021-09-23 07:54:32 -07:00
runtime Apply linter suggestions to #65137 (#65459) 2021-09-27 13:07:40 -07:00
scheduler Apply linter suggestions to #65137 (#65459) 2021-09-27 13:07:40 -07:00
tools Replace kernel resource strings with real .cu source files (#48283) 2020-12-02 21:22:29 -08:00
arith.cpp Apply linter suggestions to #65137 (#65459) 2021-09-27 13:07:40 -07:00
arith.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
codegen.cpp [ROCm] Changes not to rely on CUDA_VERSION or HIP_VERSION (#65610) 2021-09-29 09:55:43 -07:00
codegen.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
compute_at_map.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
compute_at_map.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
compute_at.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
compute_at.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
disjoint_set.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
dispatch.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
dispatch.h Apply linter suggestions to #65137 (#65459) 2021-09-27 13:07:40 -07:00
executor_kernel_arg.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
executor_kernel_arg.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
executor_launch_params.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
executor_launch_params.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
executor_utils.cpp [ROCm] Changes not to rely on CUDA_VERSION or HIP_VERSION (#65610) 2021-09-29 09:55:43 -07:00
executor_utils.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
executor.cpp [ROCm] Changes not to rely on CUDA_VERSION or HIP_VERSION (#65610) 2021-09-29 09:55:43 -07:00
executor.h Apply linter suggestions to #65137 (#65459) 2021-09-27 13:07:40 -07:00
expr_evaluator.cpp Apply linter suggestions to #65137 (#65459) 2021-09-27 13:07:40 -07:00
expr_evaluator.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
fusion_segmenter.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
fusion_segmenter.h Apply linter suggestions to #65137 (#65459) 2021-09-27 13:07:40 -07:00
fusion.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
fusion.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
graph_fuser.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
index_compute.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
index_compute.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
index_reference_replay.cpp Apply linter suggestions to #65137 (#65459) 2021-09-27 13:07:40 -07:00
index_reference_replay.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
instrumentation.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
instrumentation.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
interface.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
interface.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
ir_all_nodes.h [NVFuser] Enable E2E BCast-PWise-Reduction fusions (#43129) 2020-08-18 09:10:08 -07:00
ir_base_nodes.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
ir_base_nodes.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
ir_cloner.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
ir_cloner.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
ir_graphviz.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
ir_graphviz.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
ir_interface_nodes.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
ir_internal_nodes.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
ir_iostream.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
ir_iostream.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
ir_nodes.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
ir_printer.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
ir_utils.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
ir_utils.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
iter_visitor.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
iter_visitor.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
kernel_cache.cpp Apply linter suggestions to #65137 (#65459) 2021-09-27 13:07:40 -07:00
kernel_cache.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
kernel_expr_evaluator.cpp Apply linter suggestions to #65137 (#65459) 2021-09-27 13:07:40 -07:00
kernel_expr_evaluator.h Apply linter suggestions to #65137 (#65459) 2021-09-27 13:07:40 -07:00
kernel_ir_builder.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
kernel_ir_builder.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
kernel_ir_printer.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
kernel_ir_printer.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
kernel_ir.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
kernel_ir.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
kernel.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
kernel.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower_alias_memory.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower_alias_memory.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower_allocation.cpp Apply linter suggestions to #65137 (#65459) 2021-09-27 13:07:40 -07:00
lower_allocation.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower_expr_sort.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower_expr_sort.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower_index.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower_index.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower_insert_syncs.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower_insert_syncs.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower_loops.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower_loops.h Apply linter suggestions to #65137 (#65459) 2021-09-27 13:07:40 -07:00
lower_magic_zero.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower_magic_zero.h Apply linter suggestions to #65137 (#65459) 2021-09-27 13:07:40 -07:00
lower_misaligned_vectorization.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower_misaligned_vectorization.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower_predicate.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower_predicate.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower_shift.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower_shift.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower_thread_predicate.cpp Revert D31326599: [pytorch][PR] Compile without -Wno-unused-variable 2021-10-01 20:40:47 -07:00
lower_thread_predicate.h Apply linter suggestions to #65137 (#65459) 2021-09-27 13:07:40 -07:00
lower_trivial_reductions.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower_trivial_reductions.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower_unroll.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower_unroll.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower_utils.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower_utils.h Apply linter suggestions to #65137 (#65459) 2021-09-27 13:07:40 -07:00
lower_validation.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower_validation.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
lower2device.cpp Apply linter suggestions to #65137 (#65459) 2021-09-27 13:07:40 -07:00
lower2device.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
manager.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
manager.h Introducing TORCH_CUDA_CPP_API and TORCH_CUDA_CU_API to the code (#50627) 2021-01-21 19:09:11 -08:00
mutator.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
mutator.h [nvFuser] Switching to CudaFusionGuard from BailOut for nvfuser - update 2 (#46452) 2020-10-19 15:44:31 -07:00
parallel_dimension_map.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
parallel_dimension_map.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
parallel_type_bitmap.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
parallel_type_bitmap.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
parser.cpp [Reland] Avoid saving self for softmax and log_softmax (#66018) 2021-10-03 21:35:01 -07:00
parser.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
partition.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
partition.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
predicate_compute.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
predicate_compute.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
register_interface.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
root_domain_map.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
root_domain_map.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
shape_inference.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
shape_inference.h Introducing TORCH_CUDA_CPP_API and TORCH_CUDA_CU_API to the code (#50627) 2021-01-21 19:09:11 -08:00
tensor_view.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
transform_iter.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
transform_iter.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
transform_replay.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
transform_replay.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
transform_rfactor.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
transform_rfactor.h Introducing TORCH_CUDA_CPP_API and TORCH_CUDA_CU_API to the code (#50627) 2021-01-21 19:09:11 -08:00
type.cpp Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
type.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00
utils.cpp Apply linter suggestions to #65137 (#65459) 2021-09-27 13:07:40 -07:00
utils.h Revert "Revert D30752939: [pytorch][PR] nvfuser update" (#65137) 2021-09-22 04:54:51 -07:00