how did you solve your target labels issue? @adwaykanhere
this is key: Does Concatenate Datasets preserve class labels and indices - #3 by ptrblck
easiest solution to what I want is to do use this: Does Concatenate Datasets preserve class labels and indices - #12 by Brando_Miranda by using learn2learn’s union of data sets.