pytorch/caffe2/python
Bram Wasti 82b981e4db Update from facebook 1ee4edd286a3 (#8040)
* Adding instance weight to batch distill loss

as title

* add bfloat 16-31

added bfloat 16-31 and their respective unit tests

* [CUDA9] Upgrade - fbcode

CUDA9 upgrade diff D5654023 has been out for a while thanks to Pieter. But with time growing it's becoming quite hard to rebase, because of the symlinks and auto-generated build/config files in tp2. Break D5654023 into two diffs, one touching tp2 config files, and another one touching fbcode TARGETS file (adding nvcc flag). These two should be a bit easier to rebase (for detailed procedure see "Test Plan").

This diff can only be committed if:
1. CUDA 9 rpm is rolled out fleet-wide (TBD)
2. NVidia driver 390.40 is rolled out fleet-wide (done)
3. Upgrade CUDA 9.1, cudnn 7.1, nccl 2.1 (done)
4. Make sure all dependents are built (done)
5. Test all C2 operators, PyTorch (see test plan)

* Share intermediate int32 buffer across Conv ops

Adding a known type

* [C2 fix] infer function for ensure_cpu_output_op

this is adding the missing device funtion for ensure_cpu_output_op

* [int8] Add blob serializer/deserializer for Int8TensorCPU

To export to logfiledb

* [nomnigraph] Add try catch block to optimization passes in predictor

This will catch failures that happen in the optimization pass.

* Caffe2: avoid static initialization order fiasco for CAFFE_ENFORCE

CAFFE_ENFORCE uses strack trace fetcher. Which is currently a
global static variable. If at static initialization time CAFFE_ENFORCE
is used, this is a SIOF. Recently CAFFE_ENFORCE was added into init
functions registration, so we started to see this.

Meyers singleton is going to provide safety here. If stacktrace
fetcher was not registered yet, it will just use a dummy one.

* NUMA support in SparseNN CPU benchmark

Adding support for NUMA in SparseNN CPU benchmark

* [mobile-roofline] Add logging needed for roofline model

This should be all that's needed

* Let the operators using the same input if the operators are not chained

or else, we have to change the input data dims

* fix null-pointer-use UBSAN errors in in reshape_op.h

* revert previous fix on input blob name

as title

* Adding flag to let MineHardNegative automatically extract single value from dict

Model exporter requires the output of the model to be a struct. This makes it convenient to use those models directly in MineHardNegative by allow automatic extraction of the single element of dict, which is a common use case.

* Reverting change that broke internal tests back to OSS compatible state
2018-06-01 17:41:09 -04:00
..
docs Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
examples Update from Facebook (#6692) 2018-04-17 23:36:40 -07:00
helpers [Caffe2] Add full impl of GroupNorm (#7058) 2018-04-29 11:26:40 -07:00
ideep Fix fbcode compatibility (#7939) 2018-05-30 13:35:46 -04:00
layers Update from facebook 1ee4edd286a3 (#8040) 2018-06-01 17:41:09 -04:00
mint Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
mkl [Caffe2] Clean up ideep integration (#6881) 2018-04-24 18:32:35 -07:00
modeling Update from Facebook (#6692) 2018-04-17 23:36:40 -07:00
models [Caffe2] Revamp the convnet benchmark code by using models from model zoo (#7351) 2018-05-08 08:53:52 -07:00
onnx Enable ONNX backend Mean tests (#7985) 2018-05-31 21:03:12 +08:00
operator_test Update from facebook 1ee4edd286a3 (#8040) 2018-06-01 17:41:09 -04:00
predictor Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
rnn Fix a typo 2018-03-30 21:00:44 -07:00
test Fix occasional test timeouts 2018-01-19 20:08:58 -08:00
trt [caffe2] Change iteritems in trt/transform.py to items for python3 compatibility (#7599) 2018-05-15 20:32:06 -07:00
__init__.py Experimental support for setup.py develop mode install 2018-02-12 23:36:18 -08:00
_import_c_extension.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
allcompare_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
attention.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
benchmark_generator.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
binarysize.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
brew_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
brew.py [Caffe2] Changes done inside Facebook (#6378) 2018-04-10 21:11:43 -07:00
build.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
cached_reader.py Update from facebook (#7451) 2018-05-10 23:14:27 -07:00
caffe_translator_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
caffe_translator.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
checkpoint_test.py Update from facebook (#6871) 2018-04-23 15:01:56 -07:00
checkpoint.py Update from facebook (#6871) 2018-04-23 15:01:56 -07:00
CMakeLists.txt [Caffe2] Clean up ideep integration (#6881) 2018-04-24 18:32:35 -07:00
cnn.py [Caffe2] Changes done inside Facebook (#6378) 2018-04-10 21:11:43 -07:00
context_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
context.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
control_ops_grad.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
control_ops_util.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
control_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
control.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
convnet_benchmarks_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
convnet_benchmarks.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
core_gradients_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
core_test.py Update from facebook 1ee4edd286a3 (#8040) 2018-06-01 17:41:09 -04:00
core.py Update from facebook 1ee4edd286a3 (#8040) 2018-06-01 17:41:09 -04:00
crf.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
data_parallel_model_test.py Update from facebook (#7451) 2018-05-10 23:14:27 -07:00
data_parallel_model.py Update from facebook (#7451) 2018-05-10 23:14:27 -07:00
data_workers_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
data_workers.py Update from facebook (#7696) 2018-05-19 23:10:48 -07:00
dataio_test.py Update from facebook (#7451) 2018-05-10 23:14:27 -07:00
dataio.py Add return value to setup() function of PipedReaderBuilder (#7476) 2018-05-10 15:39:54 -07:00
dataset.py Update from facebook (#7855) 2018-05-29 11:38:02 -07:00
db_file_reader.py Update from facebook (#7855) 2018-05-29 11:38:02 -07:00
db_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
device_checker.py Update from facebook (#7451) 2018-05-10 23:14:27 -07:00
dlpack.h Support for DLPack in Python op 2017-12-21 17:02:16 -08:00
dyndep.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
embedding_generation_benchmark.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
experiment_util.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
extension_loader.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
functional_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
functional.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
fused_8bit_rowwise_conversion_ops_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
gradient_check_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
gradient_checker.py Update from facebook (#7451) 2018-05-10 23:14:27 -07:00
gru_cell.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
hsm_util.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
hypothesis_test_util.py Update from facebook (#7451) 2018-05-10 23:14:27 -07:00
hypothesis_test.py Fix flaky atomic iter test (#7649) 2018-05-17 21:17:29 -07:00
ideep_test_util.py [feature request] [Caffe2] Enable MKLDNN support for inference (#6699) 2018-04-22 21:58:14 -07:00
layer_model_helper.py Update from facebook (#7696) 2018-05-19 23:10:48 -07:00
layer_model_instantiator.py [caffe2] Fbcode to GitHub sync (#6208) 2018-04-02 16:35:27 -07:00
layer_parameter_sharing_test.py [layer model] remove duplicated init ops 2018-03-27 18:10:39 -07:00
layer_test_util.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
layers_test.py Update from facebook 1ee4edd286a3 (#8040) 2018-06-01 17:41:09 -04:00
lengths_reducer_fused_8bit_rowwise_ops_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
lengths_reducer_rowwise_8bit_ops_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
lstm_benchmark.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
memonger_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
memonger.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
mkl_test_util.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
model_device_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
model_helper.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
modifier_context.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
mpi_python.cc Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
muji_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
muji.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
net_builder_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
net_builder.py Update from Facebook (#6692) 2018-04-17 23:36:40 -07:00
net_drawer.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
net_printer_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
net_printer.py [DT] [38/n] Rename add_stop_signal to add_stop_condition (#6825) 2018-04-23 10:39:37 -07:00
numa_benchmark.py Update from facebook (#6871) 2018-04-23 15:01:56 -07:00
numa_test.py [core] NUMA-aware pinned allocator 2018-03-06 00:33:11 -08:00
observer_test.py Fix RNN scoping situation 2018-02-07 17:35:29 -08:00
optimizer_context.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
optimizer_test_util.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
optimizer_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
optimizer.py Update from facebook (#7696) 2018-05-19 23:10:48 -07:00
parallel_workers_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
parallel_workers.py Update from facebook (#7696) 2018-05-19 23:10:48 -07:00
parallelize_bmuf_distributed_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
pipeline_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
pipeline.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
predictor_constants.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
pybind_state_dlpack.cc Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
pybind_state_dlpack.h Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
pybind_state_gpu.cc [Caffe2] Provide option to initialize the TensorRT engine at Operator constructor time (#6809) 2018-04-23 13:09:35 -07:00
pybind_state_ideep.cc Move ideep ops from caffe2/contrib/ideep to caffe2/ideep (#7112) 2018-04-30 21:10:46 -07:00
pybind_state_int8.cc [C2 Int8][C2 Core]fetch int8 blob 2018-03-30 21:00:44 -07:00
pybind_state_mkl.cc Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
pybind_state.cc Update from facebook (#7696) 2018-05-19 23:10:48 -07:00
pybind_state.h [Caffe2] Workspace centric API for TensorRT transformation (#6678) 2018-04-17 21:23:27 -07:00
python_op_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
queue_util.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
record_queue.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
recurrent.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
regularizer_context.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
regularizer_test.py add dense regularization 2018-01-08 13:03:17 -08:00
regularizer.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
rnn_cell.py Fix typo in comment (#7183) 2018-05-02 11:58:30 -07:00
schema_test.py Update from facebook (#7855) 2018-05-29 11:38:02 -07:00
schema.py Update from facebook (#7855) 2018-05-29 11:38:02 -07:00
scope_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
scope.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
session_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
session.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
sparse_to_dense_mask_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
sparse_to_dense_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
task.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
test_util.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
text_file_reader.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
timeout_guard.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
toy_regression_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
transformations_test.py [caffe2][nomnigraph] Batchnorm + Conv Fusion (#7057) 2018-05-08 15:40:34 -07:00
transformations.py [caffe2][nomnigraph] Batchnorm + Conv Fusion (#7057) 2018-05-08 15:40:34 -07:00
tt_core_test.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
tt_core.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
utils.py [Caffe2][fbcode=>GH sync] Update from facebook 4323b18ce13c (#7116) 2018-05-01 20:49:00 -07:00
visualize.py Remove Apache headers from source. 2018-03-27 13:10:18 -07:00
workspace_test.py [feature request] [Caffe2] Enable MKLDNN support for inference (#6699) 2018-04-22 21:58:14 -07:00
workspace.py Update from facebook (#7696) 2018-05-19 23:10:48 -07:00