h2o CPU % usage patterns #2
Description
r3.8xlarge: CPU1 0-7 (and 16-23 hyperthread pairs), CPU2 8-15
Code https://github.com/szilard/ml-x1/blob/0f1ed269d9fefba8dc0eb16c7eaa0c94363e4e09/h2o.R
with ntrees = 3
and
n_proc <- as.numeric(commandArgs(trailingOnly=TRUE)[1])
h2o.init(max_mem_size = "30g", nthreads = n_proc)
8 cores pinned
taskset -c 0-7 Rscript h2o.R
user system elapsed
0.468 0.011 51.053
again:
user system elapsed
0.450 0.028 51.367
8 cores free
Rscript h2o.R 8
user system elapsed
0.583 0.025 55.522
again:
user system elapsed
0.555 0.016 52.407
16 cores pinned - 2CPUs, no hyper threaded
taskset -c 0-15 Rscript h2o.R 16
user system elapsed
0.384 0.014 31.657
** 16 cores pinned - 1 CPU, hyperthreaded**
taskset -c 0-7,16-23 Rscript h2o.R 16
user system elapsed
0.592 0.017 51.264
16 cores free
Rscript h2o.R 16
user system elapsed
0.479 0.012 35.626
again:
user system elapsed
0.462 0.016 35.580