I run code on someone’s data. Her data is in npz format.
But when I run the code dataloader gives error. I thought it’s data problem. But I can load data by numpy. Could some help me to sort out the problem? Thank you so much.
Here’s the error:
Traceback (most recent call last):
File “train.py”, line 66, in
for i, data in enumerate(trainloader):
File “/export/home/y/.local/lib/python3.8/site-packages/torch/utils/data/dataloader.py”, line 630, in next
data = self._next_data()
File “/export/home/y/.local/lib/python3.8/site-packages/torch/utils/data/dataloader.py”, line 1345, in _next_data
return self._process_data(data)
File “/export/home/y/.local/lib/python3.8/site-packages/torch/utils/data/dataloader.py”, line 1371, in _process_data
data.reraise()
File “/export/home/y/.local/lib/python3.8/site-packages/torch/_utils.py”, line 694, in reraise
raise exception
zlib.error: Caught error in DataLoader worker process 0.
Original Traceback (most recent call last):
File “/export/home/y/.local/lib/python3.8/site-packages/torch/utils/data/_utils/worker.py”, line 308, in _worker_loop
data = fetcher.fetch(index)
File “/export/home/y/.local/lib/python3.8/site-packages/torch/utils/data/_utils/fetch.py”, line 51, in fetch
data = [self.dataset[idx] for idx in possibly_batched_index]
File “/export/home/y/.local/lib/python3.8/site-packages/torch/utils/data/_utils/fetch.py”, line 51, in
data = [self.dataset[idx] for idx in possibly_batched_index]
File “/export/home/y/NTS-Net/core/dataset.py”, line 129, in getitem
X, Y = self.data[‘x’][index], self.data[‘y’][index]
File “/export/home/y/.local/lib/python3.8/site-packages/numpy/lib/npyio.py”, line 253, in getitem
return format.read_array(bytes,
File “/export/home/y/.local/lib/python3.8/site-packages/numpy/lib/format.py”, line 823, in read_array
data = _read_bytes(fp, read_size, “array data”)
File “/export/home/y/.local/lib/python3.8/site-packages/numpy/lib/format.py”, line 958, in _read_bytes
r = fp.read(size - len(data))
File “/usr/lib/python3.8/zipfile.py”, line 940, in read
data = self._read1(n)
File “/usr/lib/python3.8/zipfile.py”, line 1016, in _read1
data = self._decompressor.decompress(data, n)
zlib.error: Error -3 while decompressing data: invalid stored block lengths