hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Carlo Curino (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1051) YARN Admission Control/Planner: enhancing the resource allocation model with time.
Date Tue, 11 Feb 2014 02:43:24 GMT

    [ https://issues.apache.org/jira/browse/YARN-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13897477#comment-13897477
] 

Carlo Curino commented on YARN-1051:
------------------------------------

I attach a technical report that reports some compelling experimental evidence to support
this feature. The report provides a summary of
our earlier implementation, and is our general blueprint of a solution, the actual code is
being completely rewritten to clean-up and make
easier to review/evolve. With respect to what's in the report, we are adding policies to enforce
user quotas (YARN-1711), and we are leveraging
more of the ResourceRequest and ResourceCalculator expressivity. 


> YARN Admission Control/Planner: enhancing the resource allocation model with time.
> ----------------------------------------------------------------------------------
>
>                 Key: YARN-1051
>                 URL: https://issues.apache.org/jira/browse/YARN-1051
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: capacityscheduler, resourcemanager, scheduler
>            Reporter: Carlo Curino
>            Assignee: Carlo Curino
>         Attachments: curino_MSR-TR-2013-108.pdf
>
>
> In this umbrella JIRA we propose to extend the YARN RM to handle time explicitly, allowing
users to "reserve" capacity over time. This is an important step towards SLAs, long-running
services, workflows, and helps for gang scheduling.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message