Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of write2kishore@gmail.com
 designates 209.85.219.49 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAHg+sbPPJH8ZBUCXDJvqEvyX2FGxzZPMXxoa0RLOkFK-bb4+ig@mail.gmail.com>
References: 
 <CAHg+sbPPJH8ZBUCXDJvqEvyX2FGxzZPMXxoa0RLOkFK-bb4+ig@mail.gmail.com>
Date: Thu, 1 Aug 2013 14:49:07 +0530
Message-ID: 
 <CAHg+sbPESisaA_a-h2c+2fSsTvENPqHU7uyR5+FdvAbZ9yMM7w@mail.gmail.com>
Subject: Re: Extra start-up overhead with hadoop-2.1.0-beta
From: Krishna Kishore Bonagiri <write2kishore@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=e89a8f503b1689ad6c04e2df559e

--e89a8f503b1689ad6c04e2df559e
Content-Type: text/plain; charset=ISO-8859-1

Hi,
  Please share with me if you anyone has an answer or clues to my question
regarding the start up performance.

Also, one more thing I have observed today is the time taken to run a
command on a container went up by more than a second in this latest version.

When using 2.0.4-alpha, it used to take 0.3 to 0.5 seconds from the point I
call startContainer() to the  point the command is started on the container.

where as

When using 2.1.0-beta, it is taking around 1.5 seconds from the point it
came to the call back onContainerStarted() to the point the command is seen
started running on the container.

Thanks,
Kishore


On Thu, Jul 25, 2013 at 8:38 PM, Krishna Kishore Bonagiri <
write2kishore@gmail.com> wrote:

> Hi,
>
>   I have been using the hadoop-2.0.1-beta release candidate and observed
> that it is slower in running my simple application that runs on 2
> containers. I have tried to find out which parts of it is really having
> this extra overhead(compared to hadoop-2.0.4-alpha), and here is what I
> found that.
>
> 1) From the point my Client has submitted the Application Master to RM, it
> is taking 2  seconds extra
> 2) From the point my container request are set up by Application Master,
> till the containers are allocated, it is taking 2 seconds extra
>
> Is this overhead expected with the changes that went into the new version?
> Or is there to improve it by changing something in configurations or so?
>
> Thanks,
> Kishore
>

--e89a8f503b1689ad6c04e2df559e
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi,<div>=A0 Please share with me if you anyone has an answ=
er or clues to my question regarding the start up performance.=A0</div><div=
><br></div><div>Also, one more thing I have observed today is the time take=
n to run a command on a container went up by more than a second in this lat=
est version.</div>
<div><br></div><div>When using 2.0.4-alpha, it used to take 0.3 to 0.5 seco=
nds from the point I call startContainer() to the =A0point the command is s=
tarted on the container.</div><div><br></div><div>where as</div><div><br>
</div><div>When using 2.1.0-beta, it is taking around 1.5 seconds from the =
point it came to the call back=A0onContainerStarted() to the point the comm=
and is seen started running on the container.</div><div><br></div><div>Than=
ks,<br>
</div><div>Kishore</div></div><div class=3D"gmail_extra"><br><br><div class=
=3D"gmail_quote">On Thu, Jul 25, 2013 at 8:38 PM, Krishna Kishore Bonagiri =
<span dir=3D"ltr">&lt;<a href=3D"mailto:write2kishore@gmail.com" target=3D"=
_blank">write2kishore@gmail.com</a>&gt;</span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><div dir=3D"ltr">Hi,<div><br><div>=A0 I have=
 been using the hadoop-2.0.1-beta release candidate and observed that it is=
 slower in running my simple application that runs on 2 containers. I have =
tried to find out which parts of it is really having this extra overhead(co=
mpared to hadoop-2.0.4-alpha), and here is what I found that.</div>

<div><br></div><div>1) From the point my Client has submitted the Applicati=
on Master to RM, it is taking 2 =A0seconds extra</div><div>2) From the poin=
t my container request are set up by Application Master, till the container=
s are allocated, it is taking 2 seconds extra</div>

<div><br></div><div>Is this overhead expected with the changes that went in=
to the new version? Or is there to improve it by changing something in conf=
igurations or so?</div><div><br></div><div>Thanks,</div><div>Kishore</div>

</div></div>
</blockquote></div><br></div>

--e89a8f503b1689ad6c04e2df559e--