hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "gehaijiang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-6062) nodemanager memory leak
Date Sun, 08 Jan 2017 09:18:58 GMT

    [ https://issues.apache.org/jira/browse/YARN-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15809058#comment-15809058
] 

gehaijiang commented on YARN-6062:
----------------------------------

mat  information:

 类名称   (类ID)	对象个数	本身所占内存	本身加引用所占内存
java.util.concurrent.ConcurrentHashMap   (37247)	530	41K	25M
java.util.concurrent.ConcurrentHashMap$Segment[]   (41421)	530	78K	25M
java.util.concurrent.ConcurrentHashMap$Segment   (34044)	5,938	278K	25M
java.util.concurrent.ConcurrentHashMap$HashEntry[]   (37906)	5,938	1,239K	25M
java.util.concurrent.ConcurrentHashMap$HashEntry   (34043)	41,944	1,966K	25M
byte[]   (35091)	2,566	16,633K	16M
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
  (41148)	1	0K	11M
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalResourcesTrackerImpl
  (37582)	138	13K	11M
org.apache.hadoop.mapred.ShuffleHandler$HttpPipelineFactory   (45434)	1	0K	10M
org.apache.hadoop.mapred.ShuffleHandler$Shuffle   (45435)	1	0K	10M
org.apache.hadoop.mapred.IndexCache   (89561)	1	0K	10M

> nodemanager memory leak
> -----------------------
>
>                 Key: YARN-6062
>                 URL: https://issues.apache.org/jira/browse/YARN-6062
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: nodemanager
>    Affects Versions: 2.7.1
>            Reporter: gehaijiang
>         Attachments: jmap.84971.txt, jstack.84971.txt, smaps.84971.txt
>
>
>  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
>  8986 data      20   0 21.3g  19g 7376 S  5.5 20.7   2458:09 java
> 38432 data      20   0  9.8g 7.9g 6300 S 95.5  8.4  35273:23 java
>  6653 data      20   0 4558m 3.4g  10m S  9.2  3.6   6640:37 java
> $ jps
> 6653 NodeManager
> Nodemanager memory has been up,Reach  10G。
> nodemanager   yarn-env.sh  configure  (2G)
> YARN_NODEMANAGER_OPTS=" -Xms2048m -Xmn768m -Xloggc:${YARN_LOG_DIR}/nodemanager.gc.log
-XX:+PrintGCDateStamps -XX:+PrintGCDetails -XX:+PrintGCTimeStamps"



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message