Erjia Guan
425a5dc3f7
[DataLoader] Modify SamplerIDP signature ( #52104 )
...
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/52104
Make the API of `SamplerIterDataPipe` more reasonable with `sampler_args` and `sampler_kwargs`.
Test Plan: Imported from OSS
Reviewed By: glaringlee
Differential Revision: D26401494
Pulled By: ejguan
fbshipit-source-id: ee5b5c414782d0880b12968bc9c8aa470b753f6a
2021-02-11 09:29:52 -08:00
Erjia Guan
9eb70c3c78
[DataLoader] Rename Callable to Map IterDataPipe ( #51879 )
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/51879
Test Plan: Imported from OSS
Reviewed By: VitalyFedyunin
Differential Revision: D26314775
Pulled By: ejguan
fbshipit-source-id: ee77909eae97092155ed6a6c794540e68a04d754
2021-02-09 17:09:06 -08:00
Erjia Guan
104371e1dc
[DataLoader] Implement FilterIterDataPipe ( #51783 )
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/51783
Test Plan: Imported from OSS
Reviewed By: glaringlee
Differential Revision: D26277688
Pulled By: ejguan
fbshipit-source-id: 25ed7da9da88c030b29627142c2f04fed26cdcda
2021-02-09 17:06:06 -08:00
lixinyu
015cabf82a
move GroupByFilename Dataset to DataPipe ( #51709 )
...
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/51709
Move GroupByFilename Dataset to DataPipe
Test Plan: Imported from OSS
Reviewed By: ejguan
Differential Revision: D26263585
Pulled By: glaringlee
fbshipit-source-id: 00e3e13b47b89117f1ccfc4cd6239940a40d071e
2021-02-09 03:34:56 -08:00
lixinyu
482b94ae51
move RoutedDecoder Dataset to DataPipe ( #51704 )
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/51704
Test Plan: Imported from OSS
Reviewed By: ejguan
Differential Revision: D26245910
Pulled By: glaringlee
fbshipit-source-id: 91e3c9f8a6c1209c1a1a752ba29a80dbd9bf4119
2021-02-09 03:31:07 -08:00
lixinyu
1ee0c42d6d
move ZipDataset to Zip DataPipe ( #51599 )
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/51599
Test Plan: Imported from OSS
Reviewed By: ejguan
Differential Revision: D26212859
Pulled By: glaringlee
fbshipit-source-id: 3fabcf8876d3c9c24339dbf6a12e0bb04b400108
2021-02-03 15:42:59 -08:00
Erjia Guan
52de407b4b
[DataLoader] Rename Functional DataSet to DataPipe ( #51488 )
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/51488
Test Plan: Imported from OSS
Reviewed By: H-Huang
Differential Revision: D26209888
Pulled By: ejguan
fbshipit-source-id: cb8bc852b1e4d72be81e0297308a43954cd95332
2021-02-03 07:01:09 -08:00
lixinyu
c0d58bce0d
move Tar Dataset to Tar DataPipe ( #51398 )
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/51398
Test Plan: Imported from OSS
Reviewed By: ejguan
Differential Revision: D26162319
Pulled By: glaringlee
fbshipit-source-id: a84879fe4ca044e34238d5e1d31a245d4b80ae8e
2021-02-02 07:46:53 -08:00
lixinyu
5ed0ad4b6a
DataPipe naming convension update ( #51262 )
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/51262
Test Plan: Imported from OSS
Reviewed By: ejguan
Differential Revision: D26120628
Pulled By: glaringlee
fbshipit-source-id: 6855a0dd6d4a93ff93adce1039960ffd7057a827
2021-01-28 17:44:36 -08:00
