After reading the doc and a few source code, it comes to me that, despite there are Batcher and Shuffler as the built-in pipes, should we really use them instead of relying on DataLoader and Sampler?
Since it seems that Shuffler is not dynamically shuffling across epochs, which produce deterministic batches, and there is no API to know the current epoch when calling getitem (compared to the set_epoch in traditional samplers).
The former is simpler to support, while the later seems to involve some API change.
I am wondering will there be solutions for “dynamically sort the items/batches with the epoch argument” across epochs in the future?
Sorry for bothering if there is already an existing way to do this.
Thanks very much!