hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brian Loss (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HADOOP-10934) AbstractCounters.readFields doesn't clear "other" groups
Date Thu, 25 Aug 2016 16:18:21 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Brian Loss resolved HADOOP-10934.
    Resolution: Duplicate

It appears that MAPREDUCE-6199 fixes took care of this issue.

> AbstractCounters.readFields doesn't clear "other" groups
> --------------------------------------------------------
>                 Key: HADOOP-10934
>                 URL: https://issues.apache.org/jira/browse/HADOOP-10934
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 2.2.0, 2.3.0, 2.4.0, 2.4.1
>            Reporter: Brian Loss
> The readFields method of AbstractCounters clears the "framework and fs groups" map {{fgroups}},
but does not clear the "other groups" map {{groups}}. If a Counters object is used as the
key or value record reader, it will aggregate groups over all records rather than just returning
the counters for the current record.  In all likelihood, in addition to providing incorrect
data, the counter limit will also be exceeded as it is checked each time through readFields.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org

View raw message