I want to get all combintations of two dataLoaders which have different dataset size.
I can’t contain the whole data because of the GPU memory. (batch size == 32)
What I want to do is:
loader_a : [a1,a2,a3] # Acutal size: 2,500
loader_b: [b1,b2,b3,b4] # Actual size: 5,430
Get Possible Combinations:
[a1-b1]
[a1-b2]
[a1-b3]
[a1-b4]
[a2-b1]
[a2-b2]
...
[a3-b4]
for step, (data_a, data_b) in enumerate(zip(loader_a, loader_b)):
... ?