hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ishai Menache (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-3656) LowCost: A Cost-Based Placement Agent for YARN Reservations
Date Fri, 15 May 2015 23:16:59 GMT
Ishai Menache created YARN-3656:

             Summary: LowCost: A Cost-Based Placement Agent for YARN Reservations
                 Key: YARN-3656
                 URL: https://issues.apache.org/jira/browse/YARN-3656
             Project: Hadoop YARN
          Issue Type: Improvement
          Components: capacityscheduler, resourcemanager
            Reporter: Ishai Menache

YARN-1051 enables SLA support by allowing users to reserve cluster capacity ahead of time.
YARN-1710 introduced a greedy agent for placing user reservations. The greedy agent makes
fast placement decisions but at the cost of ignoring the cluster committed resources, which
might result in blocking the cluster resources for certain periods of time, and in turn rejecting
some arriving jobs.

We propose LowCost – a new cost-based planning algorithm. LowCost “spreads” the demand
of the job throughout the allowed time-window according to a global, load-based cost function.

This message was sent by Atlassian JIRA

View raw message