hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Russell Jurney <russell.jur...@gmail.com>
Subject Re: Why they recommend this (CPU) ?
Date Thu, 11 Oct 2012 17:56:36 GMT
Anyone got data on this? This is interesting, and somewhat counter-intuitive.

Russell Jurney http://datasyndrome.com

On Oct 11, 2012, at 10:47 AM, Jay Vyas <jayunit100@gmail.com> wrote:

> Presumably, if you have a reasonable number of cores - speeding the cores up will be
better than forking a task into smaller and smaller chunks - because at some point the overhead
of multiple processes would be a bottleneck - maybe due to streaming reads and writes?  I'm
sure each and every problem has a different sweet spot.

View raw message