hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mahesh Ogale <sonuog...@gmail.com>
Subject Get map and reduce phases counter values separately
Date Fri, 30 Dec 2016 23:36:41 GMT
Hello,

Here is one of the counters I am taking as an example:

Name                              Map     Reduce  Total
GC time elapsed (ms)    36,573  1,320     37,893

e.g.
${hadoop:counters('my-task-mr')['org.apache.hadoop.mapred.Task$Counter']['GC_TIME_MILLIS']}
- gives me total value 37893 (map + reduce), this works fine.

But I am not able to find anything yet to get the map and reduce values
separately.

${hadoop:counters('my-task-mr')['org.apache.hadoop.mapred.Task$Counter']['GC_TIME_MILLIS_I_AM_MAKING_THIS_UP_FOR_MAP']}
- should give me just map value (36573 from above snippet)
${hadoop:counters('my-task-mr')['org.apache.hadoop.mapred.Task$Counter']['GC_TIME_MILLIS_I_AM_MAKING_THIS_UP_FOR_REDUCE']}
- should give me just reduce value (1320 from above snippet)

Thanks,
Mahesh

Mime
View raw message