hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Dunning <tdunn...@maprtech.com>
Subject Re: Spindle per Cores
Date Fri, 12 Oct 2012 19:11:56 GMT
It depends on your distribution.  Some distributions are more efficient at
driving spindles than others.

Ratios as high as 2 spindles per core are sometimes quite reasonable.

On Fri, Oct 12, 2012 at 10:46 AM, Patai Sangbutsarakum <
silvianhadoop@gmail.com> wrote:

> I have read around about the hardware recommendation for hadoop cluster.
> One of them is recommend 1:1 ratio between spindle per core.
>
> Intel CPU come with Hyperthread which will double the number cores on
> one physical CPU. eg. 8 cores with Hyperthread it because 16 which is
> where we start to calculate about number of task slots per node.
>
> Once it come to spindle, i strongly believe I should pick 8 cores and
> picks 8 disks in order to get 1:1 ratio.
>
> Please suggest
> Patai
>

Mime
View raw message