spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Steve Loughran <>
Subject Re: spark multi tenancy
Date Wed, 07 Oct 2015 18:46:32 GMT

On 7 Oct 2015, at 11:06, ayan guha <<>>

Can queues also be used to separate workloads?

yes; that's standard practise. Different YARN queues can have different maximum memory &
CPU, and you can even tag queues as "pre-emptible", so more important work can kill containers
if there isn't space on the cluster

View raw message