Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of michael_segel@hotmail.com
 designates 65.55.34.211 as permitted sender)
Message-ID: <COL117-W4DD7AE42D28D885911B678FB50@phx.gbl>
Content-Type: multipart/alternative;
	boundary="_a81bb8f2-0f04-42a8-a411-37030e3b1aa3_"
From: Michael Segel <michael_segel@hotmail.com>
To: <common-user@hadoop.apache.org>
Subject: RE: How to control the number of map tasks for each nodes?
Date: Thu, 8 Jul 2010 20:35:31 -0500
Importance: Normal
In-Reply-To: <AANLkTindF1qHKbhDaS0JF0l0MpJgV18WZ0ne32DLONXp@mail.gmail.com>
References: 
 <AANLkTim_eETJQC5h4a1MeTGDeyvve-pK9-Q0aA-DOgQO@mail.gmail.com>,<AANLkTindF1qHKbhDaS0JF0l0MpJgV18WZ0ne32DLONXp@mail.gmail.com>
MIME-Version: 1.0

--_a81bb8f2-0f04-42a8-a411-37030e3b1aa3_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable


Just a nit.

i7s are quad core. While Intel has 2 'threads' per core. (I'm assuming you'=
re using the i7's (800 series and below) in a single socket mother board.)
Based on experience with tuning other databases=2C I am a bit skeptical abo=
ut going beyond the number of cores. Also your memory is probably going to =
be more of a driver on the number of map/reduce tasks you can run simultane=
ously.

JMHO=2C YMMV.

-Mike


> Date: Fri=2C 9 Jul 2010 10:14:14 +0900
> Subject: Re: How to control the number of map tasks for each nodes?
> From: mp2893@gmail.com
> To: common-user@hadoop.apache.org
>=20
> Thanks you all for the info.
>=20
> I have successfully configured my cluster.
> Thanks again.
>=20
> 2010/7/8 edward choi <mp2893@gmail.com>
>=20
> > Hi=2C
> >
> > I have a cluster consisting of 11 slaves and a single master.
> >
> > The thing is that 3 of my slaves have i7 cpu which means that they can =
have
> > up to 8 simultaneous processes.
> > But other slaves only have dual core cpus.
> >
> > So I was wondering if I can specify the number of map tasks for each of=
 my
> > slaves.
> > For example=2C I want to give 8 map tasks to the slaves that have i7 cp=
us and
> > only two map tasks to the others.
> >
> > Is there a way to do this?
> >
 		 	   		 =20
_________________________________________________________________
The New Busy is not the old busy. Search=2C chat and e-mail from your inbox=
.
http://www.windowslive.com/campaign/thenewbusy?ocid=3DPID28326::T:WLMTAGL:O=
N:WL:en-US:WM_HMP:042010_3=

--_a81bb8f2-0f04-42a8-a411-37030e3b1aa3_--