hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun Suresh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5082) Limit ContainerId increase in fair scheduler if the num of node app reserved reached the limit
Date Mon, 20 Jun 2016 19:17:58 GMT

    [ https://issues.apache.org/jira/browse/YARN-5082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15340215#comment-15340215
] 

Arun Suresh commented on YARN-5082:
-----------------------------------

[~vinodkv],
Even though the symptom is the same, the cause for the container ID leak in the FS and CS
look different. In the FS case, the original issue (which this JIRA fixes) was that the containerId
used to leak because a container that was created with the intent of reservation, ends up
discarded due to a threshold check. From the description and comments on YARN-5074, the cause
of leakage in the CS looks different.

> Limit ContainerId increase in fair scheduler if the num of  node app reserved reached
the limit
> -----------------------------------------------------------------------------------------------
>
>                 Key: YARN-5082
>                 URL: https://issues.apache.org/jira/browse/YARN-5082
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: sandflee
>            Assignee: sandflee
>             Fix For: 2.9.0
>
>         Attachments: YARN-5082.01.patch, YARN-5082.02.patch, YARN-5082.03.patch, YARN-5082.04.patch,
YARN-5082.addendum.patch
>
>
> see many logs like 
> {quote}
> 16/05/14 01:07:58 DEBUG fair.FSAppAttempt: Not creating reservation as container container_1463159225729_0002_01_000003
is not reservable
> 16/05/14 01:07:58 DEBUG fair.FSAppAttempt: Not creating reservation as container container_1463159225729_0002_01_000004
is not reservable
> 16/05/14 01:07:58 DEBUG fair.FSAppAttempt: Not creating reservation as container container_1463159225729_0002_01_000005
is not reservable
> 16/05/14 01:07:58 DEBUG fair.FSAppAttempt: Not creating reservation as container container_1463159225729_0002_01_000006
is not reservable
> 16/05/14 01:07:58 DEBUG fair.FSAppAttempt: Not creating reservation as container container_1463159225729_0002_01_000007
is not reservable
> {quote}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message