On Thu, Aug 14, 2014 at 2:39 AM, Ch= ris MacKenzie <studio@chrismackenziephotography.co.uk= > wrote:

Hi,

This is the content of my shell script for running the job history server:<= br>
cd $HADOOP_PREFIX
hadoop fs -mkdir -p /mr-history/tmp
hadoop fs -chmod -R 1777 /mr-history/tmp
hadoop fs -mkdir -p /mr-history/done
hadoop fs -chmod -R 1777 /mr-history/done

sbin/mr-jobhistory-daemon.sh start historyserver

These configurable variables are in mapred-site.xml

<property>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 <name>mapreduce.jobhistory.address</na= me>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 <value>137.195.143.129:10020</value>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 <description>Default port is 10020.</d= escription>
=C2=A0 =C2=A0 </property>

=C2=A0 =C2=A0 <property>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 <name>mapreduce.jobhistory.webapp.address= </name>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 <value>137.195.143.129:19888</value>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 <description>Default port is 19888.</d= escription>
=C2=A0 =C2=A0 </property>

I start the history server on the same node as my resource manager

The counters are available from when the job is running from:

http://your-server:8088/proxy/app= lication_1408007466921_0002/mapreduce/job/
job_1408007466921_0002

Drill down through the application master to the job.

If you don=C2=B9t have the history server running the job data is not
persistent.

Hope this helps.

Regards,

Chris MacKenzie
telephone: 0131 332 6967
email: studio@chr= ismackenziephotography.co.uk
corporate: www.chrismackenziephotography.co.uk
<http://www.chrismackenziephotography.co.uk/>
<http://plus.google.com/+ChrismackenziephotographyCoUk/po= sts>
<http://www.linkedin.com/in/chrismackenziephotography/><= br>

From: =C2=A0ou senshaw <senshaw@gma= il.com>
Reply-To: =C2=A0<user@hadoop.a= pache.org>
Date: =C2=A0Thursday, 14 August 2014 07:14
To: =C2=A0<user@hadoop.apache.= org>
Subject: =C2=A0Hadoop 2.2 Built-in Counters

Hi all,
I'm trying to analyze my mapreduce job performance via built-in counter= s
such as physical memory usage, heap memory usage...
When the job is running, I can watch these counters via Resource manager website(namenode:8088). However, when the job is done, counter information<= br> is not available in resource manager website anymore. I know I can get
them from client output. I was wondering if there is other place in name node or data node to get the final counter measures regarding job id?
Thanks,
Shaw