Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Sun, 24 Jul 2016 04:17:20 +0000 (UTC)
From: "Jian He (JIRA)" <jira@apache.org>
To: yarn-issues@hadoop.apache.org
Message-ID: <JIRA.12922299.1450256598000.117044.1469333840645@Atlassian.JIRA>
In-Reply-To: <JIRA.12922299.1450256598000@Atlassian.JIRA>
References: <JIRA.12922299.1450256598000@Atlassian.JIRA> <JIRA.12922299.1450256598530@arcas>
Subject: [jira] [Commented] (YARN-4464) default value of
 yarn.resourcemanager.state-store.max-completed-applications should lower.
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Sun, 24 Jul 2016 04:17:22 -0000


    [ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390935#comment-15390935 ] 

Jian He commented on YARN-4464:
-------------------------------

My opinion was that restart scenario occurs so rarely that having 1000 vs 10000 apps in store doesn't affect so much. Normal runs have no impact. Most users may not even notice the change.  Rather, changing the way how much apps kept in memory will immediately have impact. Users will likely notice the change.  I can't speak for our users/customers what number is enough usually. Is this intended for branch-2 too ? if there's no performance impact, I would rather keep the number unchanged for branch-2.   If it's only for 3.x,  maybe it's fine to keep in sync.

> default value of yarn.resourcemanager.state-store.max-completed-applications should lower.
> ------------------------------------------------------------------------------------------
>
>                 Key: YARN-4464
>                 URL: https://issues.apache.org/jira/browse/YARN-4464
>             Project: Hadoop YARN
>          Issue Type: Wish
>          Components: resourcemanager
>            Reporter: KWON BYUNGCHANG
>            Assignee: Daniel Templeton
>            Priority: Blocker
>         Attachments: YARN-4464.001.patch, YARN-4464.002.patch, YARN-4464.003.patch, YARN-4464.004.patch
>
>
> my cluster has 120 nodes.
> I configured RM Restart feature.
> {code}
> yarn.resourcemanager.recovery.enabled=true
> yarn.resourcemanager.store.class=org.apache.hadoop.yarn.server.resourcemanager.recovery.FileSystemRMStateStore
> yarn.resourcemanager.fs.state-store.uri=/system/yarn/rmstore
> {code}
> unfortunately I did not configure {{yarn.resourcemanager.state-store.max-completed-applications}}.
> so that property configured default value 10,000.
> I have restarted RM due to changing another configuartion.
> I expected that RM restart immediately.
> recovery process was very slow.  I have waited about 20min.  
> realize missing {{yarn.resourcemanager.state-store.max-completed-applications}}.
> its default value is very huge.  
> need to change lower value or document notice on [RM Restart page|http://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/ResourceManagerRestart.html].


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org