hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karthik Kambatla (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources
Date Tue, 09 Dec 2014 07:35:13 GMT

    [ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239086#comment-14239086

Karthik Kambatla commented on YARN-2618:

In the context of this JIRA, vdisks is always 1. So, the value of vdisks per container doesn't
have any meaning here :)

In the context of YARN-2139, vdisks captures both (1) proportion of disk resources and (2)
potential parallelism. The proportion of disk resources is only through enforcement. As Bikas
suggested on the umbrella JIRA and I responded, the potential parallelism (a.k.a number of
spindles) can be achieved through the number of local directories assigned to the container.

> Avoid over-allocation of disk resources
> ---------------------------------------
>                 Key: YARN-2618
>                 URL: https://issues.apache.org/jira/browse/YARN-2618
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Wei Yan
>            Assignee: Wei Yan
>         Attachments: YARN-2618-1.patch, YARN-2618-2.patch
> Subtask of YARN-2139. 
> This should include
> - Add API support for introducing disk I/O as the 3rd type resource.
> - NM should report this information to the RM
> - RM should consider this to avoid over-allocation

This message was sent by Atlassian JIRA

View raw message