I want to find a data structure to save intermediate results. Numpy and Pickle is not an option because I cannot load the data in chunks.
The data is images, but saving .jpeg
etc… is a loss of information.
How can I save these intermediate results and which enables me to load them memory efficient with a data loader?