How to use DataLoader for ReplayBuffer

In RL, the data is not static but keeps growing due to new samples explored by the agent.

I would like to use DataLoader for preparing/loading data from a replay buffer more efficiently. However, it seems that the concept of DataLoader is not well designed for non-stationary data.

So, what would be the best way to extract/load/transform data from a large replay buffer efficiently?

Thanks.

Bringing this thread up.