Data Loader giving segmentation error with more than 0 workers

I am running NN on the Summit. I am using ImageNet. I am having problem with the data loader

DataLoader(dataset, batch_size=1, shuffle=False, sampler=None,
batch_sampler=None, num_workers=0, collate_fn=None,
pin_memory=False, drop_last=False, timeout=0,

It works well with 0 workers. However, when I use more than zero workers, it gives me a segmentation error. I googled this problem. It seems that this works with many people but I see many posts which complain the same error which I am getting.