CPUs at 40% in AWS instance

1

I’m running an LSTM on a m4.16xlarge instance (64 vCPUs and 256 GiB of RAM), and I notice my CPUs have all around 60% idle. Im running using a batch size of 128.

$ mpstat
04:49:01 PM  CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
04:49:01 PM  all   38.71    0.00    2.50    0.09    0.00    0.00    0.40    0.00    0.00   58.29

How to force my system to use all available CPU?

2

it depends on the size of the LSTMs, the Intel MKL library decides whether to use all cores or not.

1 Like