My module includes a list that should be kept separate for the two replicas in my DataParallel. I essentially want to do this exact thing but with a list instead of a single value: DataParallel doesn't replicate module's member variables · Issue #2864 · pytorch/pytorch · GitHub.