I’m wondering if when setting the device in pytorch to “cpu” whether pytorch parallelizes an optimization task by default over all available cores, or whether it runs single core by default. Interested in how changing the hardware (say different architecture CPUs) changes the answer to this question if at all.