Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9869B108E9 for ; Fri, 26 Apr 2013 19:21:50 +0000 (UTC) Received: (qmail 21821 invoked by uid 500); 26 Apr 2013 19:21:45 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 21680 invoked by uid 500); 26 Apr 2013 19:21:45 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 21671 invoked by uid 99); 26 Apr 2013 19:21:45 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 26 Apr 2013 19:21:45 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of rkevinburton@charter.net designates 216.33.127.83 as permitted sender) Received: from [216.33.127.83] (HELO mta41.charter.net) (216.33.127.83) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 26 Apr 2013 19:21:39 +0000 Received: from imp11 ([10.20.200.11]) by mta41.charter.net (InterMail vM.8.01.05.02 201-2260-151-103-20110920) with ESMTP id <20130426192118.MMEF10143.mta41.charter.net@imp11> for ; Fri, 26 Apr 2013 15:21:18 -0400 Received: from wt06 ([209.225.8.46]) by imp11 with smtp.charter.net id UjMJ1l00U0zbdDt05jMJGs; Fri, 26 Apr 2013 15:21:18 -0400 X-Authority-Analysis: v=2.0 cv=dIr+A5lb c=1 sm=1 a=os3phs8/4a+HRgZgvItj1g==:17 a=3dz4mxVvhEEA:10 a=cWQ9uGxeeyIA:10 a=yUnIBFQkZM0A:10 a=hOpmn2quAAAA:8 a=tWIjD76qWq4A:10 a=OF_cJ27VAAAA:8 a=60fXib9QJO1ENTiecFsA:9 a=QEXdDO2ut3YA:10 a=hUswqBWy9Q8A:10 a=kzkqyWw76YMx8IsL_Q8A:9 a=tXsnliwV7b4A:10 a=k3HWCzo4l3ytvonl:21 a=os3phs8/4a+HRgZgvItj1g==:117 Received: from [173.227.207.246] by enhanced.charter.net with HTTP; Fri, 26 Apr 2013 15:21:18 -0400 Date: Fri, 26 Apr 2013 15:21:18 -0400 (EDT) From: rkevinburton@charter.net To: user@hadoop.apache.org Cc: user@hadoop.apache.org Message-ID: <2e708040.730243.13e47cae16d.Webtop.46@charter.net> Subject: Re: M/R Staticstics MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_27475592_2132982334.1367004078436" User-Agent: Laszlo Mail 3 X-SID: 46 X-Originating-IP: [173.227.207.246] X-Virus-Checked: Checked by ClamAV on apache.org ------=_Part_27475592_2132982334.1367004078436 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable Content-Disposition: inline I was able to overcome the permission exception in the log by creating=20 an HDFS tmp folder (hadoop fs -mkdir /tmp) and opening it up to the=20 world (hadoop fs -chmod a+rwx /tmp). That got rid of the exception put I=20 still am able to connect to port 50030 to see M/R status. More ideas? On Fri, Apr 26, 2013 at 10:37 AM, Rishi Yadav wrote: do you see "retired jobs" on job tracker page. There is also "job=20 tracker history" on the bottom of page.=C2=A0 something like this=C2=A0 http://nn.zettabyte.com:50030/jobtracker.jsp=20 Thanks and Regards, Rishi Yadav On Fri, Apr 26, 2013 at 7:36 AM, < rkevinburton@charter.net=20 =20 > wrote: When I submit a simple "Hello World" M/R job like WordCount it takes=20 less than 5 seconds. The texts show numerous methods for monitoring M/R=20 jobs as they are happening but I have yet to see any that show=20 statistics about a job after it has completed. Obviously simple jobs=20 that take a short amount of time don't allow time to fire up any web=20 mage or monitoring tool to see how it progresses through the JobTracker=20 and TaskTracker as well as which node it is processed on. Any=20 suggestions on how could see this kind of data *after* a job has=20 completed? ------=_Part_27475592_2132982334.1367004078436 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline
 
I was able to overcome the permission exception in the log by creati= ng an HDFS tmp folder (hadoop fs -mkdir /tmp) and opening it up to the worl= d (hadoop fs -chmod a+rwx /tmp). That got rid of the exception put I still = am able to connect to port 50030 to see M/R status. More ideas?

On Fri, Apr 26, 2013 at 10:37 AM, Rishi Yadav wrote:

 do you s= ee "retired jobs" on job tracker page. There is also "job tr= acker history" on the bottom of page.=C2=A0

Thanks and Regards, =
Rishi Yadav




On Fri, Apr = 26, 2013 at 7:36 AM, < rkevinburton@charter.net> wrote:
When I submit a simple "Hello World" M/R = job like WordCount it takes less than 5 seconds. The texts show numerous me= thods for monitoring M/R jobs as they are happening but I have yet to see a= ny that show statistics about a job after it has completed. Obviously simpl= e jobs that take a short amount of time don't allow time to fire up any web= mage or monitoring tool to see how it progresses through the JobTracker an= d TaskTracker as well as which node it is processed on. Any suggestions on = how could see this kind of data *after* a job has completed?
<= FONT FACE=3D"Verdana" SIZE=3D"3" COLOR=3D"#000000" LETTERSPACING=3D"0" KERN= ING=3D"0">
------=_Part_27475592_2132982334.1367004078436--