spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Steve Loughran <ste...@hortonworks.com>
Subject Re: spark multi tenancy
Date Wed, 07 Oct 2015 18:46:32 GMT

On 7 Oct 2015, at 11:06, ayan guha <guha.ayan@gmail.com<mailto:guha.ayan@gmail.com>>
wrote:


Can queues also be used to separate workloads?

yes; that's standard practise. Different YARN queues can have different maximum memory &
CPU, and you can even tag queues as "pre-emptible", so more important work can kill containers
if there isn't space on the cluster

https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html#Queue_Properties


Mime
View raw message