Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: error (nike.apache.org: encountered temporary error during SPF
 processing of domain of tianyi.zhu@facilitatedigital.com)
MIME-Version: 1.0
In-Reply-To: <BAY170-W124E5086206E98668E8945CF0630@phx.gbl>
References: <BAY170-W124E5086206E98668E8945CF0630@phx.gbl>
Date: Fri, 19 Jul 2013 16:37:21 +1000
Message-ID: 
 <CAKDLMgnfTPfv1sbS5HseK1CnHT-ZGEzBLOa=oE=+v50Va9DYyQ@mail.gmail.com>
Subject: Re: How does AWS know how many map/reduce slot should be configured
 to each EC2 instance?
From: TianYi Zhu <tianyi.zhu@facilitatedigital.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=20cf3074d2e416741504e1d78fad

--20cf3074d2e416741504e1d78fad
Content-Type: text/plain; charset=UTF-8

1. Yes, it's depends on instance type. Generally, number of map slots +
number of reduce slots = number of ECU, number of map slots / number of
reduce slots >= 3. You can customize these numbers.
2. Yes, Number of nodes * Running hours * Price per EMR node per hour (EMR
node is a little bit more expensive than EC2 node)
3. Yes, you can find them in admin console.


On 19 July 2013 16:23, WangRamon <ramon_wang@hotmail.com> wrote:

> Hi All
>
> We have a plan to move to Amazon AWS cloud, by doing some research i find
> that i can start the map/reduce cluster in AWS with the following command:
> % bin/hadoop-ec2 launch-cluster test-cluster 2
>
> The command allows me to start a cluster with required nodes(no more than
> 20, correct me if i were wrong), so here comes to my questions:
>
> 1. How does AWS know how many map/reduce slot should be configured to each
> EC2 instance? Is it depends on the EC2 instance type (m1.large,
> m1.xlarge...)?
> 2. How it is charged? Nodes number * price per node per hour ?
> 3. Is each node like a single EC2 instance in my admin console?
>
> Thanks in advance!
>
> Cheers
> Ramon
>
>

--20cf3074d2e416741504e1d78fad
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">1. Yes, it&#39;s depends on instance type. Generally, numb=
er of map slots + number of reduce slots =3D number of ECU,=C2=A0number of =
map slots /=C2=A0number of reduce slots &gt;=3D 3. You can customize these =
numbers.<div>
2. Yes, Number of nodes * Running hours * Price per EMR node per hour (EMR =
node is a little bit more expensive than EC2 node)</div><div>3. Yes, you ca=
n find them in admin console.</div></div><div class=3D"gmail_extra"><br><br=
>
<div class=3D"gmail_quote">On 19 July 2013 16:23, WangRamon <span dir=3D"lt=
r">&lt;<a href=3D"mailto:ramon_wang@hotmail.com" target=3D"_blank">ramon_wa=
ng@hotmail.com</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quote" s=
tyle=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">


<div><div dir=3D"ltr">Hi All<div><br></div><div>We have a plan to move to A=
mazon AWS cloud, by doing some research i find that i can start the map/red=
uce cluster in AWS with the following command:</div><div>% bin/hadoop-ec2 l=
aunch-cluster test-cluster 2</div>
<div><br></div><div>The command allows me to start a cluster with required =
nodes(no more than 20, correct me if i were wrong), so here comes to my que=
stions:</div><div><br></div><div>1. How does AWS know how many map/reduce s=
lot should be configured to each EC2 instance? Is it depends on the EC2 ins=
tance type (<span style=3D"font-family:&#39;Courier New&#39;,Courier,mono;f=
ont-size:12px">m1.large,=C2=A0</span><span style=3D"font-family:&#39;Courie=
r New&#39;,Courier,mono;font-size:12px">m1.xlarge...</span><span style=3D"f=
ont-size:12pt">)?</span></div>
<div>2. How it is charged?=C2=A0<span style=3D"font-size:12pt">Nodes number=
 * price per node per hour ?</span></div><div><span style=3D"font-size:12pt=
">3. Is each node like a single EC2 instance in my admin console?=C2=A0</sp=
an></div><div>
<br></div><div>Thanks in advance!</div><div><br></div><div>Cheers</div><div=
>Ramon</div><div><br></div> 		 	   		  </div></div>
</blockquote></div><br></div>

--20cf3074d2e416741504e1d78fad--