How to load a very large dataset when training a time series model?

When I was training a time series model, I had a large dataset that could only be loaded once in memory. However, if the dataloader used a worker, the GPU usage would be low, resulting in slow performance; If multiple workers are used, there will be insufficient memory. How should I load data?