hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Oleg Sukhoroslov <oleg.sukhoros...@gmail.com>
Subject Scheduler questions
Date Fri, 05 Dec 2014 10:06:35 GMT

We have a Hadoop cluster which is used by many users (students) 
competing for resources.
We would like to prioritize jobs based on resource usage history per user.
Such functionality is common among classic HPC schedulers, e.g.

AFAIK, the FairShareScheduler takes into account only current resource 
Are there any plans or ongoing efforts to implement fair share 
scheduling based on resource usage history?

A similar question regarding limiting job resource usage in a similar 
fashion as in classical HPC clusters.
Are there any plans to support specifying and enforcing limits on total 
cpu time per job or task?

Thanks a lot

-- Oleg

View raw message