IterableDataset support in Opacus

Opacus
1

Hi,

I saw that DPDataLoader currently does not support IterableDataset. How are streaming datasets and/or large datasets that cannot be fully loaded in memory due to memory limitation handled in Opacus?

Thanks,
Pooja

2

One potential get-around is to turn off the Poisson subsampling in which case you do not need DPDataLoader. I am not aware of an efficient implementation of Poisson subsampling+IterableDataset for the whole DP community.