I wanted to choose the number of workers without running my script (or at least the initial guess since I’m not really allowed to debug in the gpu’s I have access). I good idea I think I had was to check number of cpus. Thus I ran ‘lscpu’ and got this:
$ lscpu Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 80 On-line CPU(s) list: 0-79 Thread(s) per core: 2 Core(s) per socket: 20 Socket(s): 2 NUMA node(s): 2 Vendor ID: GenuineIntel CPU family: 6 Model: 79 Stepping: 1 CPU MHz: 2621.695 BogoMIPS: 4392.23 Virtualization: VT-x L1d cache: 32K L1i cache: 32K L2 cache: 256K L3 cache: 51200K NUMA node0 CPU(s): 0-19,40-59 NUMA node1 CPU(s): 20-39,60-79
with these specs what num workers would you use? By reading: https://unix.stackexchange.com/questions/218074/how-to-know-number-of-cores-of-a-system-in-linux
it seems that I have 2 real physicals cpus with 20 cores per socket…so perhaps 40 cores in total…then would that justify setting 20,40 or 2 number of workers?