OSSForks/pytorch
1
0
Fork 0
mirror of https://github.com/zebrajr/pytorch.git synced 2025-12-07 00:21:07 +01:00
Code Issues Actions 38 Packages Projects Releases Wiki Activity
58bcf76ba3
pytorch/caffe2/python
History
Lei Chen 58bcf76ba3 Have model downloading as a separate plan 
Summary:
For distributed offline training, downloading parameters from trainer_0 is part of epoch plan. However for distributed realtime training, we publish model by a specific time interval, so we need run multiple iterations for epoch plan before publishing the model.

In this diff, I split downloading parameters from epoch plan as a separate plan, so we can explicitly execute it before model publishing for distributed online training.

Reviewed By: boryiingsu

Differential Revision: D5995122

fbshipit-source-id: 47d61d7b8c57cfae156e79b7ec32068ef579d7c3
2017-10-16 16:03:48 -07:00
..
docs Re-license to Apache 2017-09-28 16:22:00 -07:00
examples Fix ImageInput op in resnet50_trainer.py 2017-10-10 11:20:52 -07:00
helpers Add missing is_test argument in ImageInput ops 2017-10-10 10:03:13 -07:00
layers Revert D6026557: [caffe2][PR] Fix "No handlers could be found for logger" 2017-10-12 20:21:52 -07:00
mint Re-license to Apache 2017-09-28 16:22:00 -07:00
mkl Re-license to Apache 2017-09-28 16:22:00 -07:00
modeling Re-license to Apache 2017-09-28 16:22:00 -07:00
models Revert D6026557: [caffe2][PR] Fix "No handlers could be found for logger" 2017-10-12 20:21:52 -07:00
operator_test Add Filler op for double 2017-10-16 13:48:15 -07:00
predictor Re-license to Apache 2017-09-28 16:22:00 -07:00
rnn Re-license to Apache 2017-09-28 16:22:00 -07:00
test Refactor executor test 2017-10-16 15:17:16 -07:00
_import_c_extension.py Re-license to Apache 2017-09-28 16:22:00 -07:00
allcompare_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
attention.py Re-license to Apache 2017-09-28 16:22:00 -07:00
benchmark_generator.py Re-license to Apache 2017-09-28 16:22:00 -07:00
binarysize.py Re-license to Apache 2017-09-28 16:22:00 -07:00
brew_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
brew.py Re-license to Apache 2017-09-28 16:22:00 -07:00
build.py Expose CMake options in the binary 2017-10-04 02:33:02 -07:00
caffe_translator_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
caffe_translator.py Translating Crop to Slice 2017-10-03 17:18:32 -07:00
checkpoint_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
checkpoint.py Have model downloading as a separate plan 2017-10-16 16:03:48 -07:00
CMakeLists.txt CMake completions work 2017-01-11 16:59:22 -08:00
cnn.py Re-license to Apache 2017-09-28 16:22:00 -07:00
context_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
context.py Re-license to Apache 2017-09-28 16:22:00 -07:00
control_ops_grad.py Re-license to Apache 2017-09-28 16:22:00 -07:00
control_ops_util.py Re-license to Apache 2017-09-28 16:22:00 -07:00
control_test.py Revert D6026557: [caffe2][PR] Fix "No handlers could be found for logger" 2017-10-12 20:21:52 -07:00
control.py Re-license to Apache 2017-09-28 16:22:00 -07:00
convnet_benchmarks_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
convnet_benchmarks.py Re-license to Apache 2017-09-28 16:22:00 -07:00
core_gradients_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
core_test.py Add missing is_test argument in ImageInput ops 2017-10-10 10:03:13 -07:00
core.py expose observers to python, add multiple observers per observable 2017-10-16 14:32:56 -07:00
crf.py Re-license to Apache 2017-09-28 16:22:00 -07:00
data_parallel_model_test.py fix memonger after D5994548 2017-10-12 17:36:27 -07:00
data_parallel_model.py Revert D6026557: [caffe2][PR] Fix "No handlers could be found for logger" 2017-10-12 20:21:52 -07:00
data_workers_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
data_workers.py Revert D6026557: [caffe2][PR] Fix "No handlers could be found for logger" 2017-10-12 20:21:52 -07:00
dataio_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
dataio.py Re-license to Apache 2017-09-28 16:22:00 -07:00
dataset.py Re-license to Apache 2017-09-28 16:22:00 -07:00
db_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
device_checker.py Re-license to Apache 2017-09-28 16:22:00 -07:00
dyndep.py Re-license to Apache 2017-09-28 16:22:00 -07:00
embedding_generation_benchmark.py Re-license to Apache 2017-09-28 16:22:00 -07:00
experiment_util.py Re-license to Apache 2017-09-28 16:22:00 -07:00
extension_loader.py Re-license to Apache 2017-09-28 16:22:00 -07:00
functional_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
functional.py Re-license to Apache 2017-09-28 16:22:00 -07:00
gradient_check_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
gradient_checker.py Re-license to Apache 2017-09-28 16:22:00 -07:00
gru_cell.py Re-license to Apache 2017-09-28 16:22:00 -07:00
hsm_util.py Re-license to Apache 2017-09-28 16:22:00 -07:00
hypothesis_test_util.py Add check for Travis in executor test 2017-10-05 11:40:23 -07:00
hypothesis_test.py Switch RNNOp to use NetDef argument for step represenetation. 2017-10-10 22:01:51 -07:00
layer_model_helper.py Revert D6026557: [caffe2][PR] Fix "No handlers could be found for logger" 2017-10-12 20:21:52 -07:00
layer_model_instantiator.py Re-license to Apache 2017-09-28 16:22:00 -07:00
layer_parameter_sharing_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
layer_test_util.py Re-license to Apache 2017-09-28 16:22:00 -07:00
layers_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
lengths_reducer_rowwise_8bit_ops_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
load_save_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
lstm_benchmark.py Re-license to Apache 2017-09-28 16:22:00 -07:00
memonger_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
memonger.py Revert D6026557: [caffe2][PR] Fix "No handlers could be found for logger" 2017-10-12 20:21:52 -07:00
mkl_test_util.py Re-license to Apache 2017-09-28 16:22:00 -07:00
model_device_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
model_helper.py Fix: ClearField only accepts string as field name 2017-10-13 10:57:34 -07:00
modifier_context.py Re-license to Apache 2017-09-28 16:22:00 -07:00
mpi_python.cc Re-license to Apache 2017-09-28 16:22:00 -07:00
muji_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
muji.py Re-license to Apache 2017-09-28 16:22:00 -07:00
net_builder_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
net_builder.py Re-license to Apache 2017-09-28 16:22:00 -07:00
net_drawer.py Revert D6026557: [caffe2][PR] Fix "No handlers could be found for logger" 2017-10-12 20:21:52 -07:00
net_printer_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
net_printer.py Print net type arguments in net_printer 2017-10-08 20:02:55 -07:00
observer_test.py expose observers to python, add multiple observers per observable 2017-10-16 14:32:56 -07:00
optimizer_context.py Re-license to Apache 2017-09-28 16:22:00 -07:00
optimizer_test_util.py Re-license to Apache 2017-09-28 16:22:00 -07:00
optimizer_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
optimizer.py Add nodename to ONE, iteration_mutex etc. 2017-10-07 22:06:11 -07:00
parallel_workers_test.py Add shutdown_fun to parallel_workers 2017-10-10 12:02:24 -07:00
parallel_workers.py Revert D6026557: [caffe2][PR] Fix "No handlers could be found for logger" 2017-10-12 20:21:52 -07:00
parallelize_gpu_bmuf_distributed_test.py Revert D6026557: [caffe2][PR] Fix "No handlers could be found for logger" 2017-10-12 20:21:52 -07:00
pipeline_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
pipeline.py Re-license to Apache 2017-09-28 16:22:00 -07:00
predictor_constants.py Re-license to Apache 2017-09-28 16:22:00 -07:00
pybind_state_gpu.cc Re-license to Apache 2017-09-28 16:22:00 -07:00
pybind_state_mkl.cc Re-license to Apache 2017-09-28 16:22:00 -07:00
pybind_state.cc expose observers to python, add multiple observers per observable 2017-10-16 14:32:56 -07:00
pybind_state.h Re-license to Apache 2017-09-28 16:22:00 -07:00
python_op_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
queue_util.py Re-license to Apache 2017-09-28 16:22:00 -07:00
record_queue.py Re-license to Apache 2017-09-28 16:22:00 -07:00
recurrent.py Switch RNNOp to use NetDef argument for step represenetation. 2017-10-10 22:01:51 -07:00
regularizer_context.py Re-license to Apache 2017-09-28 16:22:00 -07:00
regularizer.py Re-license to Apache 2017-09-28 16:22:00 -07:00
rnn_cell.py Disable cudnn dropout 2017-10-04 17:24:09 -07:00
schema_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
schema.py Revert D6026557: [caffe2][PR] Fix "No handlers could be found for logger" 2017-10-12 20:21:52 -07:00
scope_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
scope.py Tagging sparse parameters 2017-10-04 18:46:48 -07:00
session_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
session.py Re-license to Apache 2017-09-28 16:22:00 -07:00
sparse_to_dense_mask_test.py Skip negative indices 2017-10-09 16:09:50 -07:00
task.py Re-license to Apache 2017-09-28 16:22:00 -07:00
test_util.py Re-license to Apache 2017-09-28 16:22:00 -07:00
text_file_reader.py Re-license to Apache 2017-09-28 16:22:00 -07:00
timeout_guard.py Re-license to Apache 2017-09-28 16:22:00 -07:00
toy_regression_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
tt_core_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
tt_core.py Re-license to Apache 2017-09-28 16:22:00 -07:00
utils.py Re-license to Apache 2017-09-28 16:22:00 -07:00
visualize.py Re-license to Apache 2017-09-28 16:22:00 -07:00
workspace_test.py Re-license to Apache 2017-09-28 16:22:00 -07:00
workspace.py Revert D6026557: [caffe2][PR] Fix "No handlers could be found for logger" 2017-10-12 20:21:52 -07:00