Erjia Guan
1ba80264f4
[DataLoader] ConcatDataPipe ( #53301 )
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/53301
Test Plan: Imported from OSS
Reviewed By: anjali411
Differential Revision: D26829322
Pulled By: ejguan
fbshipit-source-id: eeea42fd9ab267d10f39ad7debc279eaded23570
2021-03-06 07:32:02 -08:00
Erjia Guan
c957e2ab42
Add more datapipe to functional API ( #53123 )
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/53123
Test Plan: Imported from OSS
Reviewed By: VitalyFedyunin
Differential Revision: D26756638
Pulled By: ejguan
fbshipit-source-id: 6ff0eb6c7ee702056ff19eeb723949e4642f2784
2021-03-03 07:01:00 -08:00
Erjia Guan
89b1053413
[DataLoader] Move BufferedShuffle from Dataset to DataPipe ( #52141 )
...
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/52141
Remove BufferShuffleDataSet, as it's not being used anywhere within PyTorch (no usage on Github based on a search) and it's not included in the release of PyTorch 1.7.1.
Test Plan: Imported from OSS
Reviewed By: H-Huang
Differential Revision: D26710940
Pulled By: ejguan
fbshipit-source-id: 90023b4bfb105d6aa392753082100f9181ecebd0
2021-03-01 12:54:44 -08:00
Erjia Guan
b534466f01
[DataLoader] TransformsIterDataPipe ( #52604 )
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/52604
Test Plan: Imported from OSS
Reviewed By: VitalyFedyunin
Differential Revision: D26581511
Pulled By: ejguan
fbshipit-source-id: c927726b7afba14586f16cde0237f2cef9080079
2021-02-23 15:47:27 -08:00
Erjia Guan
4ee5bc74d3
[DataLoader] Change signature of Functional DataPipe ( #52458 )
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/52458
Test Plan: Imported from OSS
Reviewed By: glaringlee
Differential Revision: D26523282
Pulled By: ejguan
fbshipit-source-id: c7358fc351f859617754a27b8a701d11ada5d61a
2021-02-18 23:30:58 -08:00
Erjia Guan
059c564ba4
[DataLoader] Fix module import ( #52224 )
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/52224
Test Plan: Imported from OSS
Reviewed By: glaringlee
Differential Revision: D26429871
Pulled By: ejguan
fbshipit-source-id: fcf2e5435658ecb92af1079def953b08cebb1f7f
2021-02-16 16:12:33 -08:00
Erjia Guan
425a5dc3f7
[DataLoader] Modify SamplerIDP signature ( #52104 )
...
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/52104
Make the API of `SamplerIterDataPipe` more reasonable with `sampler_args` and `sampler_kwargs`.
Test Plan: Imported from OSS
Reviewed By: glaringlee
Differential Revision: D26401494
Pulled By: ejguan
fbshipit-source-id: ee5b5c414782d0880b12968bc9c8aa470b753f6a
2021-02-11 09:29:52 -08:00
Erjia Guan
9eb70c3c78
[DataLoader] Rename Callable to Map IterDataPipe ( #51879 )
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/51879
Test Plan: Imported from OSS
Reviewed By: VitalyFedyunin
Differential Revision: D26314775
Pulled By: ejguan
fbshipit-source-id: ee77909eae97092155ed6a6c794540e68a04d754
2021-02-09 17:09:06 -08:00
Erjia Guan
104371e1dc
[DataLoader] Implement FilterIterDataPipe ( #51783 )
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/51783
Test Plan: Imported from OSS
Reviewed By: glaringlee
Differential Revision: D26277688
Pulled By: ejguan
fbshipit-source-id: 25ed7da9da88c030b29627142c2f04fed26cdcda
2021-02-09 17:06:06 -08:00
lixinyu
015cabf82a
move GroupByFilename Dataset to DataPipe ( #51709 )
...
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/51709
Move GroupByFilename Dataset to DataPipe
Test Plan: Imported from OSS
Reviewed By: ejguan
Differential Revision: D26263585
Pulled By: glaringlee
fbshipit-source-id: 00e3e13b47b89117f1ccfc4cd6239940a40d071e
2021-02-09 03:34:56 -08:00
lixinyu
482b94ae51
move RoutedDecoder Dataset to DataPipe ( #51704 )
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/51704
Test Plan: Imported from OSS
Reviewed By: ejguan
Differential Revision: D26245910
Pulled By: glaringlee
fbshipit-source-id: 91e3c9f8a6c1209c1a1a752ba29a80dbd9bf4119
2021-02-09 03:31:07 -08:00
lixinyu
1ee0c42d6d
move ZipDataset to Zip DataPipe ( #51599 )
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/51599
Test Plan: Imported from OSS
Reviewed By: ejguan
Differential Revision: D26212859
Pulled By: glaringlee
fbshipit-source-id: 3fabcf8876d3c9c24339dbf6a12e0bb04b400108
2021-02-03 15:42:59 -08:00
Erjia Guan
52de407b4b
[DataLoader] Rename Functional DataSet to DataPipe ( #51488 )
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/51488
Test Plan: Imported from OSS
Reviewed By: H-Huang
Differential Revision: D26209888
Pulled By: ejguan
fbshipit-source-id: cb8bc852b1e4d72be81e0297308a43954cd95332
2021-02-03 07:01:09 -08:00
lixinyu
c0d58bce0d
move Tar Dataset to Tar DataPipe ( #51398 )
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/51398
Test Plan: Imported from OSS
Reviewed By: ejguan
Differential Revision: D26162319
Pulled By: glaringlee
fbshipit-source-id: a84879fe4ca044e34238d5e1d31a245d4b80ae8e
2021-02-02 07:46:53 -08:00
lixinyu
5ed0ad4b6a
DataPipe naming convension update ( #51262 )
...
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/51262
Test Plan: Imported from OSS
Reviewed By: ejguan
Differential Revision: D26120628
Pulled By: glaringlee
fbshipit-source-id: 6855a0dd6d4a93ff93adce1039960ffd7057a827
2021-01-28 17:44:36 -08:00
