Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C16C9EC1D for ; Thu, 7 Feb 2013 01:58:53 +0000 (UTC) Received: (qmail 95340 invoked by uid 500); 7 Feb 2013 01:58:48 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 95232 invoked by uid 500); 7 Feb 2013 01:58:48 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 95225 invoked by uid 99); 7 Feb 2013 01:58:48 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 07 Feb 2013 01:58:48 +0000 X-ASF-Spam-Status: No, hits=2.4 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of java8964@hotmail.com designates 65.55.111.83 as permitted sender) Received: from [65.55.111.83] (HELO blu0-omc2-s8.blu0.hotmail.com) (65.55.111.83) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 07 Feb 2013 01:58:39 +0000 Received: from BLU162-W65 ([65.55.111.72]) by blu0-omc2-s8.blu0.hotmail.com with Microsoft SMTPSVC(6.0.3790.4675); Wed, 6 Feb 2013 17:58:18 -0800 X-EIP: [IWvWqvQ3cy3/HRBV8S7gkFOrIYnrUuo2] X-Originating-Email: [java8964@hotmail.com] Message-ID: Content-Type: multipart/alternative; boundary="_e6bd0ab0-9233-4517-bd17-eac89167c9af_" From: java8964 java8964 To: Subject: RE: Profiling the Mapper using hprof on Hadoop 0.20.205 Date: Wed, 6 Feb 2013 20:58:18 -0500 Importance: Normal In-Reply-To: References: MIME-Version: 1.0 X-OriginalArrivalTime: 07 Feb 2013 01:58:18.0438 (UTC) FILETIME=[99746E60:01CE04D6] X-Virus-Checked: Checked by ClamAV on apache.org --_e6bd0ab0-9233-4517-bd17-eac89167c9af_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable What range you gave it for mapred.task.profile.maps? And you sure your mapp= er will invoke the methods you expect in the traces? Yong Date: Wed=2C 6 Feb 2013 23:50:08 +0200 Subject: Profiling the Mapper using hprof on Hadoop 0.20.205 From: yaron.gonen@gmail.com To: user@hadoop.apache.org Hi=2CI wish to profile my mapper=2C so I've set the properties mapred.task.= profile and mapred.task.profile.maps in mapred-site.xml. At the end of the job I'm getting a profile.out file=2C however I think it'= s not the profile of the mapper... none of the methods I use in the mapper = appear on any of the traces. Am I doing something wrong? I'm using a small cluster with 4 machines. Thanks=2CYaron = --_e6bd0ab0-9233-4517-bd17-eac89167c9af_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable

What range you gave it for =3Bmapred.task.profile.maps? And you sure your mapper will in= voke the methods you expect in the traces?

Yong

Date: Wed=2C 6 Feb 2= 013 23:50:08 +0200
Subject: Profiling the Mapper using hprof on Hadoop 0= .20.205
From: yaron.gonen@gmail.com
To: user@hadoop.apache.org

Hi=2C

I wish to profile my mapper=2C so I've set the = properties =3Bmapred.task.profi= le and =3Bmapred.task.pr= ofile.maps in mapred-site.xm= l.

At the end of the job I'm getting a profile.out file=2C however I think it's not the profile of th= e mapper... none of the methods I use in the mapper appear on any of the tr= aces. Am I doing something wrong?

I'm using a small cluster with 4 machines.

Th= anks=2C

Yaron

= --_e6bd0ab0-9233-4517-bd17-eac89167c9af_--