hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Suma Shivaprasad <sumasai.shivapra...@gmail.com>
Subject Re: FileSystem Vs ZKStateStore for RM recovery
Date Wed, 11 Feb 2015 08:15:22 GMT
We have set yarn.resourcemanager.max-completed-applications=10000. I assume
this is the no of entries kept in RMStateStore since I see these in logs

2015-02-11 00:00:00,579 INFO
org.apache.hadoop.yarn.server.resourcemanager.RMAppManager: Max number of
completed apps kept in state store met: maxCompletedAppsInStateStore =
10000, removing app application_1422879343468_543109 from state store.

Thanks
Suma


On Wed, Feb 11, 2015 at 1:09 PM, Nikhil <mnikhil@gmail.com> wrote:

> >>cache 10000 entries in the state store.
> May I know what are 10000 entries you are talking about here? Any details
> please.
>
> On Tue, Feb 10, 2015 at 9:59 PM, Suma Shivaprasad <
> sumasai.shivaprasad@gmail.com> wrote:
>
>> We are planning to deploy Hadoop 2.6.0 with a default configuration to
>> cache 10000 entries in the state store. With a workload of 150-250
>> concurrent applications at any time , which state store is better to use
>> and for what reasons ?
>>
>> Thanks
>> Suma
>>
>
>

Mime
View raw message