hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Segel <michael_se...@hotmail.com>
Subject Re: Which hardware to choose
Date Wed, 03 Oct 2012 01:40:13 GMT
I think he's saying that its 24 maps 8 reducers per node and at 48GB that could be too many
mappers. 
Especially if they want to run HBase. 

On Oct 2, 2012, at 8:14 PM, hadoopman <hadoopman@gmail.com> wrote:

> Only 24 map and 8 reduce tasks for 38 data nodes?  are you sure that's right?  Sounds
VERY low for a cluster that size.
> 
> We have only 10 c2100's and are running I believe 140 map and 70 reduce slots so far
with pretty decent performance.
> 
> 
> 
> On 10/02/2012 12:55 PM, Alexander Pivovarov wrote:
>> 38 data nodes + 2 Name Nodes
>> >  >
>> >  >  Data Node:
>> >  >  Dell PowerEdge C2100 series
>> >  >  2 x XEON x5670
>> >  >  48 GB RAM ECC  (12x4GB 1333MHz)
>> >  >  12 x 2 TB  7200 RPM SATA HDD (with hot swap)  JBOD
>> >  >  Intel Gigabit ET Dual port PCIe x4
>> >  >  Redundant Power Supply
>> >  >  Hadoop CDH3
>> >  >  max map tasks 24
>> >  >  max reduce tasks 8
> 
> 


Mime
View raw message