Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2F575105B9 for ; Tue, 18 Jun 2013 15:04:45 +0000 (UTC) Received: (qmail 89816 invoked by uid 500); 18 Jun 2013 15:04:39 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 89583 invoked by uid 500); 18 Jun 2013 15:04:36 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 89574 invoked by uid 99); 18 Jun 2013 15:04:36 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 18 Jun 2013 15:04:36 +0000 X-ASF-Spam-Status: No, hits=1.8 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,MIME_QP_LONG_LINE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of yypvsxf19870706@gmail.com designates 209.85.160.50 as permitted sender) Received: from [209.85.160.50] (HELO mail-pb0-f50.google.com) (209.85.160.50) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 18 Jun 2013 15:04:28 +0000 Received: by mail-pb0-f50.google.com with SMTP id wz7so4019012pbc.37 for ; Tue, 18 Jun 2013 08:04:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:references:from:content-type:x-mailer:in-reply-to :message-id:date:to:content-transfer-encoding:mime-version; bh=ZkfBslnQYXSCCCoJ1I/LUw+yNuWKSC2ZeLjzLdwdGFA=; b=ijF7D8GSPrBVpELSwXk5MN9p0ISSRzAGoKnEae7j5uwernpA7jXlYd6VYwOiU2EvTQ 4fioFLMDlrn5Kwd8jb3FUAGqqxTQOL6YqtIe2yiOaTIZLt/A180UZ/E/kgTgHoo0pqHc Szy4W1bgaC4LbDZALbGOgwIbaVs4wsx6pjuPlcissJlrDwfU4SFWzS8FUy4LKfK+eruB DiWDfwmO5WpJykZISdzXMYjc7wgOnhcpc6NAlyryBvDpbzI+YmhvOc77e0IKXO2hWBDz jXyMIFQw199AcqgcuYlmLKqFrPg793K9ho29dOxQSVSeerracSEfEt00V4ThYjCPrxsp AavQ== X-Received: by 10.68.244.73 with SMTP id xe9mr17843094pbc.119.1371567846860; Tue, 18 Jun 2013 08:04:06 -0700 (PDT) Received: from [192.168.1.100] ([49.72.232.233]) by mx.google.com with ESMTPSA id ty8sm20041910pac.8.2013.06.18.08.04.01 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Tue, 18 Jun 2013 08:04:06 -0700 (PDT) Subject: Re: hprof profiler output location References: From: yypvsxf19870706 Content-Type: multipart/alternative; boundary=Apple-Mail-032A3331-0F8A-4DC3-977A-5AC946062591 X-Mailer: iPhone Mail (10B146) In-Reply-To: Message-Id: <686BFA60-FFB9-4113-89D3-A1DFA0D1DE73@gmail.com> Date: Tue, 18 Jun 2013 23:01:06 +0800 To: "user@hadoop.apache.org" Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (1.0) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail-032A3331-0F8A-4DC3-977A-5AC946062591 Content-Type: text/plain; charset=GB2312 Content-Transfer-Encoding: quoted-printable Hi Rahul=20 =20 I even search the files using find / - name attemp*.profile.but still no= thing was found. Can you indicate the format of the file name. Thanks=20 =B7=A2=D7=D4=CE=D2=B5=C4 iPhone =D4=DA 2013-6-18=A3=AC20:27=A3=ACRahul Bhattacharjee =D0=B4=B5=C0=A3=BA > In the same directory from which the job has been triggered. >=20 > Thanks, > Rahul >=20 >=20 > On Sun, Jun 16, 2013 at 3:33 PM, YouPeng Yang w= rote: >>=20 >> Hi All >>=20 >> I want to profile a fraction of the tasks in a job,so I configured my j= ob as [1]. >> However I could not get the hprof profiler output on the host on whic= h I submitted my job.(I use MRv2 with YARN --CDH4.1.2---) >> =20 >> =20 >> Where can I find the hprof profiler output? >>=20 >> [1] >> job.setProfileEnabled(true); >> job.setProfileParams( >> "-agentlib:hprof=3Ddepth=3D6,cpu=3Dsamples,heap=3Ds= ites,force=3Dn," + >> "thread=3Dy,verbose=3Dn,file=3D%s"); >> job.setProfileTaskRange(true, "0-2"); >> job.setProfileTaskRange(false,""); >>=20 >> or >>=20 >> job.getConfiguration().setBoolean("mapreduce.task.profile", true); >> job.getConfiguration().set("mapreduce.task.profile.params", "-agent= lib:hprof=3Dcpu=3Dsamples," + >> "heap=3Dsites,depth=3D6,force=3Dn,thread=3Dy,verbose=3Dn,file=3D%s"= ); >> job.getConfiguration().set("mapreduce.task.profile.maps", "0-2"); >> job.getConfiguration().set("mapreduce.task.profile.reduces", ""); >>=20 >>=20 >> Regards >>=20 >> Thanks. >=20 --Apple-Mail-032A3331-0F8A-4DC3-977A-5AC946062591 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable
Hi Rahul 
   =
    I even search the files using find / - name attemp*= .profile.but still nothing was found.
    Can you indica= te the format of the file name.


Than= ks 

=E5=8F=91=E8=87=AA=E6=88=91=E7=9A=84 iPhone

=E5=9C=A8 2013-6-18=EF=BC=8C20:27=EF=BC=8CRahul Bhattacharjee <rahul.rec.dgp@gmail.com> =E5=86= =99=E9=81=93=EF=BC=9A

In the same directory from which the job has been triggered.
=
Thanks,
Rahul


On Sun, Jun 16, 2013 at 3:33 PM, YouPeng Yang <<= a href=3D"mailto:yypvsxf19870706@gmail.com" target=3D"_blank">yypvsxf1987070= 6@gmail.com> wrote:

Hi All

  I want to  profile a fraction of the task= s in a job,so I configured my job as [1].
  However I could not get the hprof  profiler  output on= the host on which I submitted my job.(I use MRv2  with YARN --CDH4.1.2= ---)
  
  
  Where can I find t= he hprof  profiler  output?

[1]
job.setProfileEnabled(true);
job.setProfileParams= (
"-agentlib:hprof=3Ddepth=3D6,cpu=3Dsamples,heap=3Dsites,force=3Dn," +
"thr= ead=3Dy,verbose=3Dn,file=3D%s");
job.setProfileTaskRa= nge(true, "0-2");
job.setProfileTaskRange(false,"");

or

job.getConfiguration= ().setBoolean("mapreduce.task.profile", true);
job.getConfiguration().set("mapreduce.task.p= rofile.params", "-agentlib:hprof=3Dcpu=3Dsamples," +
"heap=3Dsites,depth=3D= 6,force=3Dn,thread=3Dy,verbose=3Dn,file=3D%s");
job.getConfiguration().set("mapreduce.task.p= rofile.maps", "0-2");
job.getConfiguration= ().set("mapreduce.task.profile.reduces", "");


<= /div>
Regards

Thanks.

= --Apple-Mail-032A3331-0F8A-4DC3-977A-5AC946062591--