Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1A976109CB for ; Tue, 19 Nov 2013 12:39:13 +0000 (UTC) Received: (qmail 11723 invoked by uid 500); 19 Nov 2013 12:38:22 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 11426 invoked by uid 500); 19 Nov 2013 12:38:13 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 11104 invoked by uid 99); 19 Nov 2013 12:38:03 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 19 Nov 2013 12:38:02 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of write2kishore@gmail.com designates 209.85.216.178 as permitted sender) Received: from [209.85.216.178] (HELO mail-qc0-f178.google.com) (209.85.216.178) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 19 Nov 2013 12:37:57 +0000 Received: by mail-qc0-f178.google.com with SMTP id i7so4784220qcq.9 for ; Tue, 19 Nov 2013 04:37:36 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=cZOCas/TvmrNietocwmrgZkfZO8aWzR2y4Yz+LIxo0M=; b=Yqa0yD7cd1QUGaxY1lYnaxhK8ZHbLIOt6b50SBLeCj7h0AFvRP3dMDoinh2+oQbtTS 3SgptLGx9XAZB11C/akb8JbIhhFM6uW8GL4Q1Cf4m8H+gSEkeEaXlDFkrwvYPlV1c5U7 6LUAhRcWhmSY8jywUGHbfZydcqbiYEyrQbpErDbfKTOgVJ37CJAzcG0KETr3W1kni/gW cbD+f6PWpBtQq0HDLsF2Si1EvAMIxx8h/6uWHZFFw9l6qXpcWMgA632Xf7BUND7nbUHI V9RicHHaQAFBwteJayqhsGUewGORE5wTPUiAblTIS0kPrhggX4kORPkF4V6teOkyCHyM b1cg== MIME-Version: 1.0 X-Received: by 10.224.73.200 with SMTP id r8mr41826670qaj.72.1384864656051; Tue, 19 Nov 2013 04:37:36 -0800 (PST) Received: by 10.96.154.40 with HTTP; Tue, 19 Nov 2013 04:37:36 -0800 (PST) In-Reply-To: References: <2075D494-C37A-4FC6-A509-356D05C11A22@hortonworks.com> Date: Tue, 19 Nov 2013 18:07:36 +0530 Message-ID: Subject: Re: Time taken for starting AMRMClientAsync From: Krishna Kishore Bonagiri To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a11c3e420e2d50b04eb86ed73 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c3e420e2d50b04eb86ed73 Content-Type: text/plain; charset=ISO-8859-1 Hi Alejandro, I don't know what are managed and unmanaged AMs, can you please explain me what are the difference and how are each of them launched? I tried to google for these terms and came across hadoop-yarn-applications-unmanaged-am-launcher-2.2.0.jar, is it related to that? Thanks, Kishore On Tue, Nov 19, 2013 at 12:15 AM, Alejandro Abdelnur wrote: > Kishore, > > Also, please specify if you are using managed or unmanaged AMs (the > numbers I've mentioned before are using unmanaged AMs). > > thx > > > On Sun, Nov 17, 2013 at 11:16 AM, Vinod Kumar Vavilapalli < > vinodkv@hortonworks.com> wrote: > >> It is just creating a connection to RM and shouldn't take that long. Can >> you please file a ticket so that we can look at it? >> >> JVM class loading overhead is one possibility but 1 sec is a bit too much. >> >> Thanks, >> +Vinod >> >> On Oct 21, 2013, at 7:16 AM, Krishna Kishore Bonagiri wrote: >> >> Hi, >> I am seeing the following call to start() on AMRMClientAsync taking >> from 0.9 to 1 second. Why does it take that long? Is there a way to reduce >> it, I mean does it depend on any of the interval parameters or so in >> configuration files? I have tried reducing the value of the first argument >> below from 1000 to 100 seconds also, but that doesn't help. >> >> AMRMClientAsync.CallbackHandler allocListener = new >> RMCallbackHandler(); >> amRMClient = AMRMClientAsync.createAMRMClientAsync(1000, >> allocListener); >> amRMClient.init(conf); >> amRMClient.start(); >> >> >> Thanks, >> Kishore >> >> >> >> CONFIDENTIALITY NOTICE >> NOTICE: This message is intended for the use of the individual or entity >> to which it is addressed and may contain information that is confidential, >> privileged and exempt from disclosure under applicable law. If the reader >> of this message is not the intended recipient, you are hereby notified that >> any printing, copying, dissemination, distribution, disclosure or >> forwarding of this communication is strictly prohibited. If you have >> received this communication in error, please contact the sender immediately >> and delete it from your system. Thank You. > > > > > -- > Alejandro > --001a11c3e420e2d50b04eb86ed73 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi Alejandro,

=A0 I don't know what are m= anaged and unmanaged AMs, can you please explain me what are the difference= and how are each of them launched?=A0

=A0I = tried to google for these terms and came across=A0hadoop-yarn-applications-= unmanaged-am-launcher-2.2.0.jar, is it related to that?

Thanks,
Kishore


On Tue, Nov 19, 2013 at 12:15 A= M, Alejandro Abdelnur <tucu@cloudera.com> wrote:
Kishore,

Also, please specify if you are using managed or unmanaged AMs (the number= s I've mentioned before are using unmanaged AMs).

thx


On Sun, Nov 17, 2013 at 11:16 AM, Vinod = Kumar Vavilapalli <vinodkv@hortonworks.com> wrote:
=
It is just creating a connection to RM = and shouldn't take that long. Can you please file a ticket so that we c= an look at it?

JVM class loading overhead is one possibi= lity but 1 sec is a bit too much.

Thanks,
+Vinod

On Oct 21, 2013, at 7:16 AM, Krishna Kishore Bonagiri wrote:<= /div>
Hi,
=A0 I am seeing= the following call to start() on AMRMClientAsync taking from 0.9 to 1 seco= nd. Why does it take that long? Is there a way to reduce it, I mean does it= depend on any of the interval parameters or so in configuration files? I h= ave tried reducing the value of the first argument below from 1000 to 100 s= econds also, but that doesn't help.

=A0 =A0 AMRMClientAsync.CallbackHandler allocListe= ner =3D new RMCallbackHandler();
=A0 =A0 amRMClient =3D AMRMClien= tAsync.createAMRMClientAsync(1000, allocListener);
=A0 =A0 amRMCl= ient.init(conf);
=A0 =A0 amRMClient.start();


<= div>Thanks,
Kishore



CONFIDENTIALITY NOTICE
NOTICE: This message is = intended for the use of the individual or entity to which it is addressed a= nd may contain information that is confidential, privileged and exempt from= disclosure under applicable law. If the reader of this message is not the = intended recipient, you are hereby notified that any printing, copying, dis= semination, distribution, disclosure or forwarding of this communication is= strictly prohibited. If you have received this communication in error, ple= ase contact the sender immediately and delete it from your system. Thank Yo= u.



--
Alejandro
--001a11c3e420e2d50b04eb86ed73--