hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Chansler (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-3422) Ganglia counter metrics are all reported with the metric name "value", so the counter values can not be seen
Date Tue, 03 Mar 2009 19:00:57 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-3422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Robert Chansler updated HADOOP-3422:
------------------------------------

    Release Note: Changed names of ganglia metrics to avoid conflicts and to better identify
source function.  (was: Produce ganglia metrics with names of the form:
jvm.metrics.*
mapred.job.Job Counters .*
mapred.job.Map-Reduce Framework.*
mapred.job.Map-Reduce Framework.*
mapred.job.Map-Reduce Framework.*
mapred.jobtracker.*
mapred.shuffleInput.*
mapred.tasktracker.*

instead of just using the last token name, or in the case of Per Job Counters, the string
value, for all counters.

The net result of this change is that the metrics names make it clear which part of hadoop
is reporting, and the counter values each have their own RRD file instead of all the counters
being aggregated under the name "value")
    Hadoop Flags: [Incompatible change, Reviewed]  (was: [Reviewed])

Edit release note for publication.

jvm.metrics.*
mapred.job.Job Counters .*
mapred.job.Map-Reduce Framework.*
mapred.job.Map-Reduce Framework.*
mapred.job.Map-Reduce Framework.*
mapred.jobtracker.*
mapred.shuffleInput.*
mapred.tasktracker.*

instead of just using the last token name, or in the case of Per Job Counters, the string
value, for all counters.

The net result of this change is that the metrics names make it clear which part of hadoop
is reporting, and the counter values each have their own RRD file instead of all the counters
being aggregated under the name "value"

> Ganglia counter metrics are all reported with the metric name "value", so the counter
values can not be seen
> ------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-3422
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3422
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: metrics
>    Affects Versions: 0.17.2, 0.18.0, 0.18.1, 0.18.2
>            Reporter: Jason
>            Assignee: stack
>             Fix For: 0.20.0
>
>         Attachments: diff-20080520-1025.txt, ganglia-patch-3422-and-4137.patch, ganglia-patch-3422-and-4137.patch,
ganglia-patch-3422-qand-4137-1.patch, ganglia-patch-3422-updated-v2.patch, ganglia-patch-3422-updated.patch
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> The JobInProgress class reports all metrics with the name "value". The FileMetrics class
puts all of the tags into the name when reporting the individual values, but the Ganglia Context
does not put the tags into the name..
> This patch modifies the context to build names for the counter metrics out of the tag
values. This enables the user to see the indivdual counter values with the ganglia web tool,
on a per job basis

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message