Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of yaron.gonen@gmail.com
 designates 209.85.214.49 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <BLU162-W65FD7CB09BA2CA600E0D18D0060@phx.gbl>
References: 
 <CAKj4OnwowsiNmbo+0opo4_X6r9gpQTpeE0Z-BtN42NriESPH+Q@mail.gmail.com>
	<BLU162-W65FD7CB09BA2CA600E0D18D0060@phx.gbl>
Date: Thu, 7 Feb 2013 06:47:28 +0200
Message-ID: 
 <CAKj4Onz3GpObxPk+LorpD6-CZnDZCpZXm4ZHqBaqYsn=Xc6fdw@mail.gmail.com>
Subject: RE: Profiling the Mapper using hprof on Hadoop 0.20.205
From: Yaron Gonen <yaron.gonen@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=0015174be284d29ee004d51b238d

--0015174be284d29ee004d51b238d
Content-Type: text/plain; charset=ISO-8859-1

I tried various range values.
I'm not even seeing the map method and the recordreader methods.
On Feb 7, 2013 3:58 AM, "java8964 java8964" <java8964@hotmail.com> wrote:

>  What range you gave it for mapred.task.profile.maps? And you sure your
> mapper will invoke the methods you expect in the traces?
>
> Yong
>
> ------------------------------
> Date: Wed, 6 Feb 2013 23:50:08 +0200
> Subject: Profiling the Mapper using hprof on Hadoop 0.20.205
> From: yaron.gonen@gmail.com
> To: user@hadoop.apache.org
>
> Hi,
> I wish to profile my mapper, so I've set the properties
> mapred.task.profile and mapred.task.profile.maps in mapred-site.xml.
> At the end of the job I'm getting a profile.out file, however I think
> it's not the profile of the mapper... none of the methods I use in the
> mapper appear on any of the traces. Am I doing something wrong?
> I'm using a small cluster with 4 machines.
>
> Thanks,
> Yaron
>

--0015174be284d29ee004d51b238d
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<p dir=3D"ltr">I tried various range values.<br>
I&#39;m not even seeing the map method and the recordreader methods.</p>
<div class=3D"gmail_quote">On Feb 7, 2013 3:58 AM, &quot;java8964 java8964&=
quot; &lt;<a href=3D"mailto:java8964@hotmail.com">java8964@hotmail.com</a>&=
gt; wrote:<br type=3D"attribution"><blockquote class=3D"gmail_quote" style=
=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">


<div><div dir=3D"ltr">
What range you gave it for=A0<span style=3D"color:rgb(42,42,42);font-family=
:&#39;courier new&#39;,monospace">mapred.task.profile.maps? And you sure yo=
ur mapper will invoke the methods you expect in the traces?</span><div><fon=
t color=3D"#2a2a2a" face=3D"courier new, monospace"><br>
</font></div><div><font color=3D"#2a2a2a" face=3D"courier new, monospace">Y=
ong<br></font><br><div><div></div><hr>Date: Wed, 6 Feb 2013 23:50:08 +0200<=
br>Subject: Profiling the Mapper using hprof on Hadoop 0.20.205<br>From: <a=
 href=3D"mailto:yaron.gonen@gmail.com" target=3D"_blank">yaron.gonen@gmail.=
com</a><br>
To: <a href=3D"mailto:user@hadoop.apache.org" target=3D"_blank">user@hadoop=
.apache.org</a><br><br><div dir=3D"ltr">Hi,<div>I wish to profile my mapper=
, so I&#39;ve set the properties=A0<font face=3D"courier new, monospace">ma=
pred.task.profile</font> and=A0<font face=3D"courier new, monospace">mapred=
.task.profile.maps</font> in <font face=3D"courier new, monospace">mapred-s=
ite.xml</font>.</div>

<div>At the end of the job I&#39;m getting a <font face=3D"courier new, mon=
ospace">profile.out</font> file, however I think it&#39;s not the profile o=
f the mapper... none of the methods I use in the mapper appear on any of th=
e traces. Am I doing something wrong?</div>

<div>I&#39;m using a small cluster with 4 machines.</div><div><br></div><di=
v>Thanks,</div><div>Yaron</div></div></div></div> 		 	   		  </div></div>
</blockquote></div>

--0015174be284d29ee004d51b238d--