hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Karthik Kambatla <ka...@cloudera.com>
Subject Re: YARN Fair Scheduler
Date Tue, 23 Feb 2016 05:05:52 GMT
Hey Prabhu

Are all the 250 queues always active? If not, the actual (instantaneous)
fairshare used by the scheduler only considers the active queues (i.e.,
those that have running applications). Otherwise, you can tune your queues
(weights, nesting etc.) so the critical queues get a bigger share.

Hope that helps.

On Mon, Feb 22, 2016 at 5:07 PM, Prabhu Joseph <prabhujose.gates@gmail.com>

> Hi All,
>    When YARN Fair Scheduler is configured with a parent root and 250 child
> queues for a big Cluster having total resource of 10TB and 3000 Cores. The
> fair share of a child queue is very less. Fair Share is Total Cluster
> resource / total number of child queues. How to design a Fair Scheduler
> with many like 250 number of queues in such a way, each queue gets more
> fair share.
> Is having Nested Queues or configuring weight or any other way to design.
> Thanks,
> Prabhu Joseph

View raw message