.idx files missing. can they be generated?

Hello. I have a script which processes given data and produces a pytorch binary output (.bin and .idx files). When I run this script in isolation everything works fine. But when I run multiple instances (using thread pool) of this script in parallel, I see that some of the output folders have missing .idx files. Any ideas why this could be happening ?

Also can we regenerate the .idx files based on the .bin files ?

I’m not sure if this issue is PyTorch-related or is rather an issue in your multi-threaded application.
Are these files only missing, if you created them from PyTorch or also as plain Python files?