hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bikas Saha (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1197) Add container merge support in YARN
Date Fri, 13 Sep 2013 17:10:53 GMT

    [ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13766650#comment-13766650

Bikas Saha commented on YARN-1197:

bq. 1) We can incrementally send resource request with small resources like before, until
we get enough resources in total
bq. 2) Merge resource in the same node, make only one big container in each node
When the RM is asked for a container then this is what the RM does. It incrementally adds
reserved space on a node until it can allocate the full resources desired by the container.
Then it assigns the container to the app. So its not clear how making small allocations and
then merging them in the app is going to help.
By asking the RM directly for 10G resources we can ensure that the RM will eventually give
us that. If we ask for 10 1G resources then we are not guaranteed that the RM will give them
to us on the same node and thus the overall request may be unsatisfiable.

> Add container merge support in YARN
> -----------------------------------
>                 Key: YARN-1197
>                 URL: https://issues.apache.org/jira/browse/YARN-1197
>             Project: Hadoop YARN
>          Issue Type: Task
>          Components: api, nodemanager, resourcemanager
>    Affects Versions: 2.1.0-beta
>            Reporter: Wangda Tan
> Currently, YARN cannot support merge several containers in one node to a big container,
which can make us incrementally ask resources, merge them to a bigger one, and launch our
processes. The user scenario is described in the comments.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message