Assigning weights to individual datasets in ConcatDataset

You could use a WeightedRandomSampler as described in this post.