I’m running an LSTM on a m4.16xlarge instance (64 vCPUs and 256 GiB of RAM), and I notice my CPUs have all around 60% idle. Im running using a batch size of 128.
$ mpstat
04:49:01 PM  CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
04:49:01 PM  all   38.71    0.00    2.50    0.09    0.00    0.00    0.40    0.00    0.00   58.29

How to force my system to use all available CPU?