CPUs at 40% in AWS instance

I’m running an LSTM on a m4.16xlarge instance (64 vCPUs and 256 GiB of RAM), and I notice my CPUs have all around 60% idle. Im running using a batch size of 128.

$ mpstat
04:49:01 PM  CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
04:49:01 PM  all   38.71    0.00    2.50    0.09    0.00    0.00    0.40    0.00    0.00   58.29

How to force my system to use all available CPU?

it depends on the size of the LSTMs, the Intel MKL library decides whether to use all cores or not.

1 Like