spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From shane knapp <skn...@berkeley.edu>
Subject FYI: i've doubled the jenkins executors for every build node
Date Mon, 29 Sep 2014 21:20:09 GMT
we were running at 8 executors per node, and BARELY even stressing the
machines (32 cores, ~230G RAM).

in the interest of actually using system resources, and giving ourselves
some headroom, i upped the executors to 16 per node.  i'll be keeping an
eye on ganglia for the rest of the week to make sure everything's cool.

i hope you all enjoy your freshly allocated capacity!  :)

shane

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message