DataLoader for stream data (ReplayBuffer in Reinforcement Learning)

(longvt) #1

Dear Pytorch community,
Is there any way to apply DataLoader to get mini-batch on online stream data (like ReplayBuffer in Reinforcement Learning)
As I know, DataLoader initializes the whole data before train and it very inefficiently when re-initializing data every time data changes (ReplayBuffer increases or changes)

Thank you so much for your help!