hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Carlo Curino (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1711) CapacityOverTimePolicy: a policy to enforce quotas over time for YARN-1709
Date Fri, 27 Jun 2014 01:47:24 GMT

    [ https://issues.apache.org/jira/browse/YARN-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14045429#comment-14045429

Carlo Curino commented on YARN-1711:

Attached a patch that provide 2 simple policies for sharing resources. 
* The NoOverCommitPolicy simply enforce plan physical resource availability (as multiple agents
from YARN-1710 could concurrently try to add to the plan).
* The CapacityOvertimePolicy is a natural exension of the notion of Capacity where each user
is given a maximum instantaneous limit (e.g., 50% of the plan capacity in any instant in time),
and a maximum integral limit (e.g., no more than 10% in average an any 24h period of time).
Setting the 3 parameters of maxInstantaneous, maxAverage, and validationWindow, allows administrators
to choose how flexible or strict is the sharing.... on one extreme the administrator can impose
instantaneous limits equivalent to user-limit in a regular queue, and on the opposite it can
allow users to grab large blocks of resources for large period of time (before having to yield
to others).

As mentioned for other sub-tasks of YARN-1051 the patch is marked available to signal its
availability for review, but not committable on its own.

> CapacityOverTimePolicy: a policy to enforce quotas over time for YARN-1709
> --------------------------------------------------------------------------
>                 Key: YARN-1711
>                 URL: https://issues.apache.org/jira/browse/YARN-1711
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Carlo Curino
>            Assignee: Carlo Curino
>              Labels: reservations
>         Attachments: YARN-1711.patch
> This JIRA tracks the development of a policy that enforces user quotas (a time-extension
of the notion of capacity) in the inventory subsystem discussed in YARN-1709.

This message was sent by Atlassian JIRA

View raw message