hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (JIRA)" <j...@apache.org>
Subject [jira] [Reopened] (HADOOP-13362) DefaultMetricsSystem leaks the source name when a source unregisters
Date Mon, 11 Jul 2016 14:55:11 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-13362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jason Lowe reopened HADOOP-13362:
---------------------------------
      Assignee: Junping Du

Reopening to target a fix just to the DefaultMetricsSystem for 2.7 rather than pulling in
the entire patch from YARN-5296 (and its dependencies).

> DefaultMetricsSystem leaks the source name when a source unregisters
> --------------------------------------------------------------------
>
>                 Key: HADOOP-13362
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13362
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: metrics
>    Affects Versions: 2.7.2
>            Reporter: Jason Lowe
>            Assignee: Junping Du
>            Priority: Critical
>
> Ran across a nodemanager that was spending most of its time in GC.  Upon examination
of the heap most of the memory was going to the map of names in org.apache.hadoop.metrics2.lib.UniqueNames.
 In this case the map had almost 2 million entries.  Looking at a few of the map showed entries
like "ContainerResource_container_e01_1459548490386_8560138_01_002020", "ContainerResource_container_e01_1459548490386_2378745_01_000410",
etc.
> Looks like the ContainerMetrics for each container will cause a unique name to be registered
with UniqueNames and the name will never be unregistered.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message