hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Accessing Job counters displayed in WEB GUI in Hadoop Code
Date Mon, 12 Dec 2011 06:52:41 GMT
Hej again,

You can get task data via the completion events call from your client:
http://hadoop.apache.org/common/docs/r0.20.1/api/org/apache/hadoop/mapreduce/Job.html#getTaskCompletionEvents(int)

They should carry the data you seek.

On Mon, Dec 12, 2011 at 4:47 AM, W.P. McNeill <billmcn@gmail.com> wrote:
> You can read counter values from the Job.getCounters API
> (http://hadoop.apache.org/common/docs/r0.20.1/api/org/apache/hadoop/mapreduce/Job.html).
> I'm not sure about the other information like execution times. I've
> been wondering that myself.
>
> On 12/10/11, ArunKumar <arunk786@gmail.com> wrote:
>> Hai guys !
>>
>> Can i access the Job counters displayed in WEB GUI in Hadoop code when the
>> job finished their execution ?
>> If so, how can i access the values like "average task run time" and counters
>> "FILE/HDFS BYTES READ/WRITTEN" immediately after the job has completed in
>> JobQueueTaskScheduler Code or in some other code file ?
>>
>>
>> Thanks,
>> Arun
>>
>> --
>> View this message in context:
>> http://lucene.472066.n3.nabble.com/Accessing-Job-counters-displayed-in-WEB-GUI-in-Hadoop-Code-tp3576925p3576925.html
>> Sent from the Hadoop lucene-users mailing list archive at Nabble.com.
>>



-- 
Harsh J

Mime
View raw message