Is there any way to do use num_workers > 0 and avoid using pickle?

data
1

Hi,

I am computing a scipy SuperLU object in my preprocessing. However this object cannot be pickled nor dilled. Hence, when using num_workers > 0, I get as expected AttributeError: Can't pickle local object

Is there any way to still paralellize my preprocessing ?

Thanks
Thibault