Return-Path: 
 <user-return-8751-apmail-hadoop-mapreduce-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 4183F10CC7
	for <apmail-hadoop-mapreduce-user-archive@minotaur.apache.org>;
 Sun, 16 Jun 2013 10:04:35 +0000 (UTC)
Received: (qmail 56240 invoked by uid 500); 16 Jun 2013 10:04:29 -0000
Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org
Received: (qmail 55793 invoked by uid 500); 16 Jun 2013 10:04:24 -0000
Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:user@hadoop.apache.org>
List-Id: <user.hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Delivered-To: mailing list user@hadoop.apache.org
Received: (qmail 55786 invoked by uid 99); 16 Jun 2013 10:04:23 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 16 Jun 2013 10:04:23 +0000
X-ASF-Spam-Status: No, hits=1.7 required=5.0
	tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of yypvsxf19870706@gmail.com
 designates 209.85.128.66 as permitted sender)
Received: from [209.85.128.66] (HELO mail-qe0-f66.google.com) (209.85.128.66)
    by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 16 Jun 2013 10:04:16 +0000
Received: by mail-qe0-f66.google.com with SMTP id 2so731919qea.5
        for <user@hadoop.apache.org>; Sun, 16 Jun 2013 03:03:55 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:date:message-id:subject:from:to:content-type;
        bh=qPS6H/T2t5EIGbLaGkYBFlD2wXtwF6urLrdVrVPqWKE=;
        b=Odvw5VE5vTGgTB9uVjmkBaMNQQEeMCeQVPKVRmqAlKgrGKFTWz50bIyqyV5mlWpfri
         DkpvqwJc/l3r3e8hhwkD+S/vZlLISe4cfr4G4YUhHpx9QVi64iUNYJwwmDA8BJEMjAfE
         /2zalvIdBwHO6wBZJd1R12dLKOvqQ9072etya7Uu2/+82k3wvUIWYcBEfdDnPK6glVov
         DWOWVKLoMU36q6zN6evuJkMnkJt8FejNIMRLVsDQKWdVS+Vyi28xTzXATuICgm9jXjUs
         h8eFt4bXSjFaJ1kxIBr9fPTY0e718uMHSbXCxZP2l2+nbXLFUUlnoROUiw7c96dy3bGM
         FhNA==
MIME-Version: 1.0
X-Received: by 10.229.156.16 with SMTP id u16mr4229718qcw.97.1371377035640;
 Sun, 16 Jun 2013 03:03:55 -0700 (PDT)
Received: by 10.49.62.33 with HTTP; Sun, 16 Jun 2013 03:03:55 -0700 (PDT)
Date: Sun, 16 Jun 2013 18:03:55 +0800
Message-ID: 
 <CAG1CohT31M3MQqY5B_mDPutUEtjWhpBq4MiXbWh43PYLGH5d9Q@mail.gmail.com>
Subject: hprof profiler output location
From: YouPeng Yang <yypvsxf19870706@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=f46d043bd7b81004d304df4299e7
X-Virus-Checked: Checked by ClamAV on apache.org

--f46d043bd7b81004d304df4299e7
Content-Type: text/plain; charset=ISO-8859-1

Hi All

  I want to  profile a fraction of the tasks in a job,so I configured my
job as [1].
  However I could not get the hprof  profiler  output on the host on which
I submitted my job.(I use MRv2  with YARN --CDH4.1.2---)


  Where can I find the hprof  profiler  output?

[1]
job.setProfileEnabled(true);
job.setProfileParams(
"-agentlib:hprof=depth=6,cpu=samples,heap=sites,force=n," +
"thread=y,verbose=n,file=%s");
job.setProfileTaskRange(true, "0-2");
job.setProfileTaskRange(false,"");

or

job.getConfiguration().setBoolean("mapreduce.task.profile", true);
job.getConfiguration().set("mapreduce.task.profile.params",
"-agentlib:hprof=cpu=samples," +
"heap=sites,depth=6,force=n,thread=y,verbose=n,file=%s");
job.getConfiguration().set("mapreduce.task.profile.maps", "0-2");
job.getConfiguration().set("mapreduce.task.profile.reduces", "");


Regards

Thanks.

--f46d043bd7b81004d304df4299e7
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div><br></div><div>Hi All</div><div><br></div><div>=A0 I =
want to =A0profile a fraction of the tasks in a job,so I configured my job =
as [1].</div><div>=A0 However I could not get the hprof =A0profiler =A0outp=
ut on the host on which I submitted my job.(I use MRv2 =A0with YARN --CDH4.=
1.2---)</div>
<div>=A0=A0</div><div>=A0=A0</div><div>=A0 Where can I find the hprof =A0pr=
ofiler =A0output?</div><div><br></div><div><span class=3D"" style=3D"white-=
space:pre">	</span>[1]</div><div><span class=3D"" style=3D"white-space:pre"=
>	</span>job.setProfileEnabled(true);</div>
<div><span class=3D"" style=3D"white-space:pre">	</span>job.setProfileParam=
s(</div><div><span class=3D"" style=3D"white-space:pre">			</span>&quot;-ag=
entlib:hprof=3Ddepth=3D6,cpu=3Dsamples,heap=3Dsites,force=3Dn,&quot; +</div=
><div><span class=3D"" style=3D"white-space:pre">			</span>&quot;thread=3Dy=
,verbose=3Dn,file=3D%s&quot;);</div>
<div><span class=3D"" style=3D"white-space:pre">	</span>job.setProfileTaskR=
ange(true, &quot;0-2&quot;);</div><div><span class=3D"" style=3D"white-spac=
e:pre">	</span>job.setProfileTaskRange(false,&quot;&quot;);</div><div><br><=
/div>
<div><span class=3D"" style=3D"white-space:pre">	</span>or</div><div><br></=
div><div><span class=3D"" style=3D"white-space:pre">	</span>job.getConfigur=
ation().setBoolean(&quot;mapreduce.task.profile&quot;, true);</div><div><sp=
an class=3D"" style=3D"white-space:pre">	</span>job.getConfiguration().set(=
&quot;mapreduce.task.profile.params&quot;, &quot;-agentlib:hprof=3Dcpu=3Dsa=
mples,&quot; +</div>
<div><span class=3D"" style=3D"white-space:pre">	</span>&quot;heap=3Dsites,=
depth=3D6,force=3Dn,thread=3Dy,verbose=3Dn,file=3D%s&quot;);</div><div><spa=
n class=3D"" style=3D"white-space:pre">	</span>job.getConfiguration().set(&=
quot;mapreduce.task.profile.maps&quot;, &quot;0-2&quot;);</div>
<div><span class=3D"" style=3D"white-space:pre">	</span>job.getConfiguratio=
n().set(&quot;mapreduce.task.profile.reduces&quot;, &quot;&quot;);</div><di=
v><br></div><div><br></div><div style>Regards</div><div style><br></div><di=
v style>
Thanks.</div></div>

--f46d043bd7b81004d304df4299e7--