Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Mon, 21 Aug 2017 22:35:00 +0000 (UTC)
From: "Ray Chiang (JIRA)" <jira@apache.org>
To: yarn-issues@hadoop.apache.org
Message-ID: <JIRA.13066557.1493086394000.84103.1503354900870@Atlassian.JIRA>
In-Reply-To: <JIRA.13066557.1493086394000@Atlassian.JIRA>
References: <JIRA.13066557.1493086394000@Atlassian.JIRA> <JIRA.13066557.1493086394742@jira-lw-us.apache.org>
Subject: [jira] [Commented] (YARN-6523) RM requires large memory in sending
 out security tokens as part of Node Heartbeat in large cluster
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Mon, 21 Aug 2017 22:35:14 -0000


    [ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135951#comment-16135951 ] 

Ray Chiang commented on YARN-6523:
----------------------------------

Looks like there hasn't been much movement on this recently.  [~Naganarasimha], we're about a month away from beta1.  In case there isn't a second beta, what is the likelihood we can get this one done?

> RM requires large memory in sending out security tokens as part of Node Heartbeat in large cluster
> --------------------------------------------------------------------------------------------------
>
>                 Key: YARN-6523
>                 URL: https://issues.apache.org/jira/browse/YARN-6523
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: RM
>    Affects Versions: 2.8.0, 2.7.3
>            Reporter: Naganarasimha G R
>            Assignee: Naganarasimha G R
>            Priority: Critical
>
> Currently as part of heartbeat response RM sets all application's tokens though all applications might not be active on the node. On top of it NodeHeartbeatResponsePBImpl converts tokens for each app into SystemCredentialsForAppsProto. Hence for each node and each heartbeat too many SystemCredentialsForAppsProto objects were getting created.
> We hit a OOM while testing for 2000 concurrent apps on 500 nodes cluster with 8GB RAM configured for RM


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org