hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "M. C. Srivas" <mcsri...@gmail.com>
Subject Re: Cluster hard drive ratios
Date Wed, 04 May 2011 22:17:47 GMT
Hey Matt,

 we are using the same Dell boxes, and we can get 2 GB/s per node (read and
write) without problems.


On Wed, May 4, 2011 at 8:43 AM, Matt Goeke <msgdh8@gmail.com> wrote:

> I have been reviewing quite a few presentations on the web from
> various businesses, in addition to the ones I watched first hand at
> the cloudera data summit last week, and I am curious as to others
> thoughts around hard drive ratios. Various sources including Cloudera
> have sited 1 HDD x 2 cores x 4 GB ECC but this makes me wonder what
> the upper bound for HDDs is in this ratio. We have specced out various
> machines from Dell and it is possible to get dual hexacores with 14
> drives (2 raided for OS and 12x2TB) but this seems to conflict with
> that original ratio and some of the specs I have witnessed in
> presentations (which are mostly 4 drive configurations). I would
> assume all you incur is additional complexity and more potential for
> hardware failure on a specific machine but I have seen little to no
> data stating at what point there is a plateau in write speed
> performance. Can anyone give personal experience around this type of
> setup?
>
> If we accept that we are incurring the negatives I stated above but we
> gain higher data density in the cluster then is this setup fine or we
> overlooking something?
>
> Thanks,
> Matt
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message