hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5353) ResourceManager can leak delegation tokens when they are shared across apps
Date Tue, 12 Jul 2016 14:26:20 GMT

    [ https://issues.apache.org/jira/browse/YARN-5353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372953#comment-15372953
] 

Jason Lowe commented on YARN-5353:
----------------------------------

Test failures are unrelated and pass for me locally with the patch applied.  The TestRMWebServicesDelegationTokenAuthentication
failure is tracked by YARN-4813 and the TestAMRestart failure is tracked by YARN-5317.

> ResourceManager can leak delegation tokens when they are shared across apps
> ---------------------------------------------------------------------------
>
>                 Key: YARN-5353
>                 URL: https://issues.apache.org/jira/browse/YARN-5353
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>    Affects Versions: 2.7.0, 2.6.1
>            Reporter: Jason Lowe
>            Assignee: Jason Lowe
>            Priority: Critical
>         Attachments: YARN-5353.001.patch
>
>
> Recently saw a ResourceManager go into heavy GC.  Heap dump showed that there were millions
of delegation tokens on the heap.  It looks like most of them belonged to the appTokens map
in DelegationTokenRenewer.  When an app completes and tokens are removed for it, I noticed
that the appTokens entry for the app is not cleaned up if tokens were shared with other active
apps.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message