hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bharath Mundlapudi <bharathw...@yahoo.com>
Subject Re: measure the time taken to complete map and reduce phase
Date Tue, 05 Jul 2011 03:06:48 GMT
Short answer: Job History Logs(JHL).
Long answer: JHL stores all the meta information related to jobs which were executed like
Job start/finish, Task start/finish, TaskAttempt start/finish.

Job.Map_Phase = Function ( Job.Map(first).StartTime, Job.Map(last).FinishTime)
Job.Reduce_Phase = Function ( Job.Reduce(first).StartTime, Job.Reduce(last).FinishTime)
  

-Bharath



________________________________
From: sangroya <sangroyaamit@gmail.com>
To: hadoop-user@lucene.apache.org
Sent: Monday, July 4, 2011 2:12 AM
Subject: measure the time taken to complete map and reduce phase

Hi,

I am trying to monitor the time to complete a map phase and reduce
phase in hadoop. Is there any way to measure the time taken to
complete map and reduce phase in a cluster.

Thanks,
Amit

--
View this message in context: http://lucene.472066.n3.nabble.com/measure-the-time-taken-to-complete-map-and-reduce-phase-tp3136991p3136991.html
Sent from the Hadoop lucene-users mailing list archive at Nabble.com.
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message