hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2745) Extend YARN to support multi-resource packing of tasks
Date Mon, 29 Jun 2015 17:46:08 GMT

    [ https://issues.apache.org/jira/browse/YARN-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605974#comment-14605974
] 

Allen Wittenauer commented on YARN-2745:
----------------------------------------

Personally, I'd prefer that what is built now get moved before adding more stuff to it.  The
ACL disaster (where we have completely different systems to manage what are effectively the
same resoruce) is a great example of what happens if the one side doesn't think the other
side is ready.    

Please please please, push this into common (and as a HADOOP JIRA instead of hiding it in
YARN) sooner rather than later so that we don't have the same mistake made over and over over
again.

> Extend YARN to support multi-resource packing of tasks
> ------------------------------------------------------
>
>                 Key: YARN-2745
>                 URL: https://issues.apache.org/jira/browse/YARN-2745
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: nodemanager, resourcemanager, scheduler
>            Reporter: Robert Grandl
>            Assignee: Robert Grandl
>         Attachments: sigcomm_14_tetris_talk.pptx, tetris_design_doc.docx, tetris_paper.pdf
>
>
> In this umbrella JIRA we propose an extension to existing scheduling techniques, which
accounts for all resources used by a task (CPU, memory, disk, network) and it is able to achieve
three competing objectives: fairness, improve cluster utilization and reduces average job
completion time.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message