hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Segel <michael_se...@hotmail.com>
Subject Re: Hardware specs calculation for io
Date Wed, 13 Jun 2012 18:52:49 GMT
You will want something in between...

8 cores means 8 spindles. 

16 cores means 16 spindles. 

You may want to up the memory, especially if you're running or thinking about running HBase.


If you go beyond 4 spindles, you will saturate your 1GBe link. If you think about Type B,
you will need 10GBe.


On Jun 13, 2012, at 9:36 AM, Sandeep Reddy P wrote:

> Hi,
> I need to know difference between two hardware configurations below for
> 24TB of data. (slave machines only for hadoop,hive and pig)
> 
> TYPE A: 2 quad core, 32 GB memory, 6 x 1TB drives(6TB / machine)
> 
> TYPE B: 4 quad core, 48 GB memory, 12 x 1TB drives (12TB / machine)
> 
> suppose we choose 4 type A machines for 24tb of data and 2 type b machines
> for 24 tb data. Assuming disk io speed is constant (7200 RPM sata), cost is
> same for 4Type A and 2 Type B machines.
> 
> I need which type of machines will give me best results in terms of
> performance.
> 
> 
> -- 
> Thanks,
> sandeep


Mime
View raw message