hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Varun Saxena (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5353) ResourceManager can leak delegation tokens when they are shared across apps
Date Tue, 12 Jul 2016 15:10:21 GMT

    [ https://issues.apache.org/jira/browse/YARN-5353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15373026#comment-15373026
] 

Varun Saxena commented on YARN-5353:
------------------------------------

LGTM.
Will commit it later today unless there are further comments.

> ResourceManager can leak delegation tokens when they are shared across apps
> ---------------------------------------------------------------------------
>
>                 Key: YARN-5353
>                 URL: https://issues.apache.org/jira/browse/YARN-5353
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>    Affects Versions: 2.7.0, 2.6.1
>            Reporter: Jason Lowe
>            Assignee: Jason Lowe
>            Priority: Critical
>         Attachments: YARN-5353.001.patch
>
>
> Recently saw a ResourceManager go into heavy GC.  Heap dump showed that there were millions
of delegation tokens on the heap.  It looks like most of them belonged to the appTokens map
in DelegationTokenRenewer.  When an app completes and tokens are removed for it, I noticed
that the appTokens entry for the app is not cleaned up if tokens were shared with other active
apps.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message