pytorch/torch/utils/data
SsnL ed19580dc4 Fix dataloader._shutdown_workers if not all workers are started (#23761)
Summary:
Otherwise you may see errors like
```
Exception ignored in: <function _MultiProcessingDataLoaderIter.__del__ at 0x000001F99F5CB9D8>
Traceback (most recent call last):
  File "C:\Users\Divyansh J\Anaconda3\envs\pytorch\lib\site-packages\torch\utils\data\dataloader.py", line 883, in __del__
    self._shutdown_workers()
  File "C:\Users\Divyansh J\Anaconda3\envs\pytorch\lib\site-packages\torch\utils\data\dataloader.py", line 860, in _shutdown_workers
    if self.workers_status[worker_id]:
IndexError: list index out of range
```

e.g. https://discuss.pytorch.org/t/how-to-construct-dataset-with-iterator-for-multi-process-dataloader/49612/5
Pull Request resolved: https://github.com/pytorch/pytorch/pull/23761

Differential Revision: D16644687

Pulled By: soumith

fbshipit-source-id: a60e847431264525079456ff422317af1ac2be4b
2019-08-07 09:06:11 -07:00
..
_utils Fix pin_memory_thread not exiting quickly (#23646) 2019-08-01 15:24:14 -07:00
__init__.py Add IterableDataset (#19228) 2019-06-20 20:12:44 -07:00
__init__.pyi Type annotations for util.data. (#18963) 2019-04-08 09:52:53 -07:00
dataloader.py Fix dataloader._shutdown_workers if not all workers are started (#23761) 2019-08-07 09:06:11 -07:00
dataloader.pyi Type annotations for util.data. (#18963) 2019-04-08 09:52:53 -07:00
dataset.py update IterableDataset doc to be consistent with current behavior 2019-06-26 06:49:22 -07:00
dataset.pyi Type annotations for util.data. (#18963) 2019-04-08 09:52:53 -07:00
distributed.py Make shuffling optional in DistributedSampler (#22479) 2019-07-05 18:56:28 -07:00
distributed.pyi Type annotations for util.data. (#18963) 2019-04-08 09:52:53 -07:00
sampler.py Add IterableDataset (#19228) 2019-06-20 20:12:44 -07:00
sampler.pyi Type annotations for util.data. (#18963) 2019-04-08 09:52:53 -07:00