hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karthik Kambatla (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers
Date Mon, 25 Apr 2016 06:42:13 GMT

    [ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15255967#comment-15255967
] 

Karthik Kambatla commented on YARN-1011:
----------------------------------------

The prototype I have been working on is here: https://github.com/kambatla/hadoop/commits/dev-1011-public.
It is a little hacky, particularly on the NM-side, and needs integration with YARN-2883 and
other cgroup changes for a clean implementation. Fixed issues found in basic testing. 

I will be running some more involved tests in the next few weeks to identify any major design/implementation
short-comings. Will report back and attempt to answer any unanswered questions asked so far.


> [Umbrella] Schedule containers based on utilization of currently allocated containers
> -------------------------------------------------------------------------------------
>
>                 Key: YARN-1011
>                 URL: https://issues.apache.org/jira/browse/YARN-1011
>             Project: Hadoop YARN
>          Issue Type: New Feature
>            Reporter: Arun C Murthy
>         Attachments: patch-for-yarn-1011.patch, yarn-1011-design-v0.pdf, yarn-1011-design-v1.pdf,
yarn-1011-design-v2.pdf
>
>
> Currently RM allocates containers and assumes resources allocated are utilized.
> RM can, and should, get to a point where it measures utilization of allocated containers
and, if appropriate, allocate more (speculative?) containers.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message