hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "vishal.rajan (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (YARN-6470) Node manager offheap memory leak
Date Mon, 17 Apr 2017 04:36:42 GMT

    [ https://issues.apache.org/jira/browse/YARN-6470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965661#comment-15965661
] 

vishal.rajan edited comment on YARN-6470 at 4/17/17 4:36 AM:
-------------------------------------------------------------

smaps file,jvm heap dump and yarn-site attached.


was (Author: vishal.rajan):
smaps file attached.

> Node manager offheap memory leak
> --------------------------------
>
>                 Key: YARN-6470
>                 URL: https://issues.apache.org/jira/browse/YARN-6470
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: yarn
>    Affects Versions: 2.7.1
>            Reporter: vishal.rajan
>         Attachments: heap, test, yarn-site.xml
>
>
> In our production environment we are seeing NM process leaking memory, this is off heap
memory.NM jvm seems to be using memory within xmx limits.
> output of top
>  PID USER      PR  NI  VIRT  RES  SHR S  %CPU %MEM    TIME+  COMMAND                
                                                                                         
     
> 32668 yarn      20   0 18.1g  16g 7244 S    19 17.0  55659:03 java    
> output of ps
> yarn     32668     1 33  2016 ?        38-15:39:18 /usr/lib/jvm/jdk-8-oracle-x64/bin/java
-Dproc_nodemanager -Xmx4096m -Dhdp.version=2.4.0.0-169 -Dhadoop.log.dir=/grid/1/log/hadoop-yarn/yarn
> OS:debian7  
> java version: oracle java8u25.
> Yarn nodemanager-recovery is enabled.
> The process needs to run for a month for this leak to occur.Please let us know if more
stats/info are required.
> Have attached smaps and heapdump file.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message