hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ivan Tretyakov <itretya...@griddynamics.com>
Subject Limit on total jobs running using fair scheduler
Date Tue, 19 Nov 2013 11:26:45 GMT
Hello!

We are using CDH 4.1.1 (Version: 2.0.0-mr1-cdh4.1.1) and fair-scheduler.
We need to limit total number of jobs which can run at the same time on
cluster.
I can see maxRunningJobs options but it sets limit for pool or user.
We wouldn't like to limit each pool or user we just need to set limit on
total number of jobs running.

Is it possible to do it using fair scheduler?
Can capacity scheduler help here?
Maybe there are other options to achieve the goal?

Thanks in advance!

-- 
Best Regards
Ivan Tretyakov

Mime
View raw message