xgboost CPU % usage patterns #1
Description
r3.8xlarge: CPU1 0-7 (and 16-23 hyperthread pairs), CPU2 8-15
Code https://github.com/szilard/ml-x1/blob/0f1ed269d9fefba8dc0eb16c7eaa0c94363e4e09/xgb.R
with nrounds = 5
4 cores pinned
taskset -c 0-3 Rscript xgb.R 4
user system elapsed
189.030 1.152 50.426
again:
user system elapsed
190.939 0.936 50.849
4 cores free
Rscript xgb.R 4
user system elapsed
234.080 4.646 60.194
again:
user system elapsed
233.196 6.740 60.509
8 cores pinned
taskset -c 0-7 Rscript xgb.R 8
user system elapsed
254.61 1.22 34.91
again:
user system elapsed
253.253 1.248 34.785
8 cores free
Rscript xgb.R 8
user system elapsed
322.178 7.387 41.923
again:
user system elapsed
337.113 9.666 44.249
(will vary)
32 cores
Rscript xgb.R 32
user system elapsed
1666.628 231.929 64.016