mirror of
https://github.com/zebrajr/pytorch.git
synced 2025-12-07 12:21:27 +01:00
664fe34e0a
* [fix] Re-enable events in RNN ops We have earlier added event disabling in RNN ops as back then we didn't use events, with current use cases this is no longer true (https://fburl.com/8vd0lp8y) * use ops with cude impl * Revert D7729695: [caffe2][fix] Re-enable events in RNN ops This reverts commit 4b215c7496fb724656ff4c776933a15bdbbcde5e @bypass-lint An infra SEV is better than not reverting this diff. If you copy this password, see you in SEV Review! @cause_a_sev_many_files * [observer] Clean up observer_config.h #accept2ship * [1/n] Refactor dataio_test.py Replace code duplication with a common function * Add barrier net that runs before training nets Add a synchonize barrier net that is run before training nets. With this net, shards that are faster will wait for other shards before start training. This reduce chances of the faster shards timing out during GLOO AllReduce. Removed explicit data_parallel_model.py.synchronize call in holmes workflow. Similar change in speech/asr_training workflow will come in another diff. * Support the dnnlowp backend in caffe2_benchmark This is for SHARE operator latency evaluation * Migrate integral_image_op to main caffe2 migrate integral_image_op(GPU version) given by https://fburl.com/yvqezigi to caffe2/caffe2/operators and implement its CPU version. Write up a test using the hypothesis_test mechanism * [pos_disc, fbcode] Implement unjoined lr loss As explained in https://our.intern.facebook.com/intern/wiki/Model_Based_Calibration/, when the dataset is an joined data set, where labels might change later, we need to use unjoined logloss. The implementation is almost the same as in Sigrid (https://fburl.com/1trngsls), where loss = y (log(p) - log(1-p)) + (1-y)(log(1-p)) = xy - (1-y)x - (1-y)log(1+exp(-x)) For x < 0, to ensure stability and avoid overflow, we reformulate the above exp as loss = xy - (1-y)x - (1-y)x + (1-y)log(1+exp(x)) = xy + (1-y)log(1+exp(x)) Then the final expression becomes loss = xy + (y - 1) x (x >= 0) - (1 - y) log(1 + exp(x - 2 x (x >= 0))) where y is the true label, x is the dot product and p = logistic(x). This kind of implementation is align with the current implementation of the original cross entropy in https://phabricator.intern.facebook.com/diffusion/FBS/browse/master/fbcode/caffe2/caffe2/operators/cross_entropy_op.cc;0bae3b5d0f825897c5e0dd0ff10f489d7271bf25$7-13 * Keep the array to fix the conflict * [C2] Compute Adagrad effective LR The AdagradWithLR op outputs an extra blob which is contains the average effective learning rate across all weights in this blob. * Open-source extractMetaNetDef & runGlobalInitialization, add new Predictor constructor from db file, and add run_map_outputs 1. Open-source extractMetaNetDef and runGlobalInitialization, for use in 2. new Predictor constructor from db file. 3. Add new run function that returns outputs as TensorMap * Disable eigen cpu Disable eigen cpu in transpose and reduce * Introduce request_only/object_only property of ModelLayer by default this is False * A simple TC Caffe2 benchmark We can run tunner, get MappingOptions and then use them to compare against cuBLAS currently broken due to LLVM issues. How to run: hg checkout eec1ab31b59c03b8deded1c755a9abaf8c45be01 add D7401202 add D7434625 add D7506031 add D7540728 buck run @mode/dev-nosan tc/tc/benchmarks_python:caffe2_benchmark * Move Caffe2 feature_maps_ops to open source Need feature maps operators in open source project facebookresearch/BlueWhale * Manually fix the conflicts in channel shuffle op * Fix the inconsistency between different gh and fbcode * Skip Adagrad GPU Test (Because some gpu implementation is missing) * Fix another test to make sure it won't run on gpu when implementation is not available yet |
||
|---|---|---|
| .. | ||
| activation_ops_test.py | ||
| adagrad_test.py | ||
| adam_test.py | ||
| apmeter_test.py | ||
| arg_max_test.py | ||
| arg_ops_test.py | ||
| assert_test.py | ||
| atomic_ops_test.py | ||
| basic_rnn_test.py | ||
| batch_box_cox_test.py | ||
| batch_sparse_to_dense_op_test.py | ||
| bbox_transform_test.py | ||
| blobs_queue_db_test.py | ||
| boolean_mask_test.py | ||
| boolean_unmask_test.py | ||
| cast_op_test.py | ||
| ceil_op_test.py | ||
| channel_backprop_stats_op_test.py | ||
| channel_shuffle_test.py | ||
| channel_stats_op_test.py | ||
| checkpoint_test.py | ||
| clip_op_test.py | ||
| clip_tensor_op_test.py | ||
| collect_and_distribute_fpn_rpn_proposals_op_test.py | ||
| concat_split_op_test.py | ||
| conditional_test.py | ||
| conv_test.py | ||
| conv_transpose_test.py | ||
| copy_ops_test.py | ||
| cosine_embedding_criterion_op_test.py | ||
| counter_ops_test.py | ||
| crf_test.py | ||
| cross_entropy_ops_test.py | ||
| cudnn_recurrent_test.py | ||
| dataset_ops_test.py | ||
| deform_conv_test.py | ||
| depthwise_3x3_conv_test.py | ||
| distance_op_test.py | ||
| dropout_op_test.py | ||
| duplicate_operands_test.py | ||
| elementwise_linear_op_test.py | ||
| elementwise_logical_ops_test.py | ||
| elementwise_op_broadcast_test.py | ||
| elementwise_ops_test.py | ||
| emptysample_ops_test.py | ||
| enforce_finite_op_test.py | ||
| extend_tensor_op_test.py | ||
| fc_operator_test.py | ||
| feature_maps_ops_test.py | ||
| filler_ops_test.py | ||
| find_op_test.py | ||
| flatten_op_test.py | ||
| flexible_top_k_test.py | ||
| floor_op_test.py | ||
| gather_ops_test.py | ||
| gather_ranges_op_test.py | ||
| given_tensor_fill_op_test.py | ||
| glu_op_test.py | ||
| group_conv_test.py | ||
| group_norm_op_test.py | ||
| gru_test.py | ||
| hsm_test.py | ||
| im2col_col2im_test.py | ||
| image_input_op_test.py | ||
| index_hash_ops_test.py | ||
| index_ops_test.py | ||
| instance_norm_test.py | ||
| integral_image_ops_test.py | ||
| jsd_ops_test.py | ||
| key_split_ops_test.py | ||
| lars_test.py | ||
| layer_norm_op_test.py | ||
| lc_operator_test.py | ||
| leaky_relu_test.py | ||
| learning_rate_op_test.py | ||
| lengths_pad_op_test.py | ||
| lengths_tile_op_test.py | ||
| lengths_top_k_ops_test.py | ||
| listwise_l2r_operator_test.py | ||
| load_save_test.py | ||
| loss_ops_test.py | ||
| lpnorm_op_test.py | ||
| map_ops_test.py | ||
| margin_ranking_criterion_op_test.py | ||
| math_ops_test.py | ||
| matmul_op_test.py | ||
| mean_op_test.py | ||
| merge_id_lists_op_test.py | ||
| mkl_conv_op_test.py | ||
| mkl_packed_fc_op_test.py | ||
| mkl_speed_test.py | ||
| mod_op_test.py | ||
| moments_op_test.py | ||
| momentum_sgd_test.py | ||
| mpi_test.py | ||
| negate_gradient_op_test.py | ||
| ngram_ops_test.py | ||
| normalize_op_test.py | ||
| numpy_tile_op_test.py | ||
| one_hot_ops_test.py | ||
| onnx_while_test.py | ||
| pack_ops_test.py | ||
| pack_rnn_sequence_op_test.py | ||
| pad_test.py | ||
| partition_ops_test.py | ||
| percentile_op_test.py | ||
| piecewise_linear_transform_test.py | ||
| pooling_test.py | ||
| prepend_dim_test.py | ||
| python_op_test.py | ||
| rank_loss_operator_test.py | ||
| rebatching_queue_test.py | ||
| record_queue_test.py | ||
| recurrent_net_executor_test.py | ||
| recurrent_network_test.py | ||
| reduce_ops_test.py | ||
| reduction_ops_test.py | ||
| relu_op_test.py | ||
| reshape_ops_test.py | ||
| resize_op_test.py | ||
| rmac_regions_op_test.py | ||
| rnn_cell_test.py | ||
| segment_ops_test.py | ||
| selu_op_test.py | ||
| sequence_ops_test.py | ||
| shape_inference_test.py | ||
| sinusoid_position_encoding_op_test.py | ||
| softmax_ops_test.py | ||
| softplus_op_test.py | ||
| sparse_gradient_checker_test.py | ||
| sparse_lengths_sum_benchmark.py | ||
| sparse_normalize_test.py | ||
| sparse_ops_test.py | ||
| sparse_to_dense_mask_op_test.py | ||
| spatial_bn_op_test.py | ||
| specialized_segment_ops_test.py | ||
| square_root_divide_op_test.py | ||
| stats_ops_test.py | ||
| string_ops_test.py | ||
| text_file_reader_test.py | ||
| thresholded_relu_op_test.py | ||
| tile_op_test.py | ||
| top_k_test.py | ||
| transpose_op_test.py | ||
| unique_ops_test.py | ||
| unique_uniform_fill_op_test.py | ||
| utility_ops_test.py | ||
| video_input_op_test.py | ||
| weighted_multi_sample_test.py | ||
| weighted_sample_test.py | ||
| weighted_sum_test.py | ||