Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of tucu@cloudera.com designates
 209.85.128.42 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAHg+sbOrFLefV3V_oUsyKT2unAzxQDvOyaMz_S8ii5a84D7oRQ@mail.gmail.com>
References: 
 <CAHg+sbOrFLefV3V_oUsyKT2unAzxQDvOyaMz_S8ii5a84D7oRQ@mail.gmail.com>
From: Alejandro Abdelnur <tucu@cloudera.com>
Date: Mon, 21 Oct 2013 08:53:38 -0700
Message-ID: 
 <CAJs-t7M1Wkixbt73qyimvW-44rGcoQc=19cEV-yGUZWYvBaerw@mail.gmail.com>
Subject: Re: Time taken for starting AMRMClientAsync
To: "common-user@hadoop.apache.org" <user@hadoop.apache.org>
Content-Type: multipart/alternative; boundary=089e0149cf967842b504e9424b51

--089e0149cf967842b504e9424b51
Content-Type: text/plain; charset=ISO-8859-1

Hi Krishna,

Those 900ms seems consistent with the numbers we  found while doing some
benchmarks in the context of Llama:

http://cloudera.github.io/llama/

"We found that the first application master created from a client process
takes around 900 ms to be ready to submit resource requests. Subsequent
application masters created from the same client process take a mean of 20
ms. The application master submission throughput (discarding the first
submission) tops at approximately 100 application masters per second."

I believe there is room for improvement there.

Cheers


On Mon, Oct 21, 2013 at 7:16 AM, Krishna Kishore Bonagiri <
write2kishore@gmail.com> wrote:

> Hi,
>   I am seeing the following call to start() on AMRMClientAsync taking from
> 0.9 to 1 second. Why does it take that long? Is there a way to reduce it, I
> mean does it depend on any of the interval parameters or so in
> configuration files? I have tried reducing the value of the first argument
> below from 1000 to 100 seconds also, but that doesn't help.
>
>     AMRMClientAsync.CallbackHandler allocListener = new
> RMCallbackHandler();
>     amRMClient = AMRMClientAsync.createAMRMClientAsync(1000,
> allocListener);
>     amRMClient.init(conf);
>     amRMClient.start();
>
>
> Thanks,
> Kishore
>
>


-- 
Alejandro

--089e0149cf967842b504e9424b51
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi Krishna,<div><br></div><div>Those 900ms seems consisten=
t with the numbers we =A0found while doing some benchmarks in the context o=
f Llama:</div><div><br></div><div><a href=3D"http://cloudera.github.io/llam=
a/">http://cloudera.github.io/llama/</a><br>

</div><div><br></div><div><span style=3D"color:rgb(0,0,0);font-family:Verda=
na,Helvetica,Arial,sans-serif;font-size:12px;line-height:15.59375px">&quot;=
We found that the first application master created from a client process ta=
kes around 900 ms to be ready to submit resource requests. Subsequent appli=
cation masters created from the same client process take a mean of 20 ms. T=
he application master submission throughput (discarding the first submissio=
n) tops at approximately 100 application masters per second.&quot;</span><b=
r>

</div><div><span style=3D"color:rgb(0,0,0);font-family:Verdana,Helvetica,Ar=
ial,sans-serif;font-size:12px;line-height:15.59375px"><br></span></div><div=
><span style=3D"color:rgb(0,0,0);font-family:Verdana,Helvetica,Arial,sans-s=
erif;font-size:12px;line-height:15.59375px">I believe there is room for imp=
rovement there.</span></div>

<div><span style=3D"color:rgb(0,0,0);font-family:Verdana,Helvetica,Arial,sa=
ns-serif;font-size:12px;line-height:15.59375px"><br></span></div><div><span=
 style=3D"color:rgb(0,0,0);font-family:Verdana,Helvetica,Arial,sans-serif;f=
ont-size:12px;line-height:15.59375px">Cheers</span></div>

</div><div class=3D"gmail_extra"><br><br><div class=3D"gmail_quote">On Mon,=
 Oct 21, 2013 at 7:16 AM, Krishna Kishore Bonagiri <span dir=3D"ltr">&lt;<a=
 href=3D"mailto:write2kishore@gmail.com" target=3D"_blank">write2kishore@gm=
ail.com</a>&gt;</span> wrote:<br>

<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><div dir=3D"ltr">Hi,<div>=A0 I am seeing the=
 following call to start() on AMRMClientAsync taking from 0.9 to 1 second. =
Why does it take that long? Is there a way to reduce it, I mean does it dep=
end on any of the interval parameters or so in configuration files? I have =
tried reducing the value of the first argument below from 1000 to 100 secon=
ds also, but that doesn&#39;t help.</div>


<div><br></div><div><div>=A0 =A0 AMRMClientAsync.CallbackHandler allocListe=
ner =3D new RMCallbackHandler();</div><div>=A0 =A0 amRMClient =3D AMRMClien=
tAsync.createAMRMClientAsync(1000, allocListener);</div><div>=A0 =A0 amRMCl=
ient.init(conf);</div>


<div>=A0 =A0 amRMClient.start();</div></div><div><br></div><div><br></div><=
div>Thanks,</div><div>Kishore</div><div><br></div></div>
</blockquote></div><br><br clear=3D"all"><div><br></div>-- <br>Alejandro
</div>

--089e0149cf967842b504e9424b51--