hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Suma Shivaprasad <sumasai.shivapra...@gmail.com>
Subject Re: FileSystem Vs ZKStateStore for RM recovery
Date Wed, 11 Feb 2015 09:08:34 GMT
Can ZKStateStore scale for large clusters. Any idea on the number of
concurrent jobs that can be supported on top of these ?

Thanks
Suma

On Wed, Feb 11, 2015 at 1:45 PM, Karthik Kambatla <kasha@cloudera.com>
wrote:

> We recommend ZK-store, particularly if you plan to deploy multiple
> ResourceManagers with failover. ZK-store ensures a single RM has write
> access and thus is better protected against split-brain cases where both
> RMs think they are active.
>
> On Tue, Feb 10, 2015 at 9:59 PM, Suma Shivaprasad <
> sumasai.shivaprasad@gmail.com> wrote:
>
>> We are planning to deploy Hadoop 2.6.0 with a default configuration to
>> cache 10000 entries in the state store. With a workload of 150-250
>> concurrent applications at any time , which state store is better to use
>> and for what reasons ?
>>
>> Thanks
>> Suma
>>
>
>
>
> --
> Karthik Kambatla
> Software Engineer, Cloudera Inc.
> --------------------------------------------
> http://five.sentenc.es
>
>

Mime
View raw message