Loading huge data functionality

Out of curiosity, have you tried using ConcatDataset? I noticed that seemed to be the answer in a similar question someone had.