hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Varun Vasudev (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources
Date Wed, 10 Dec 2014 11:13:13 GMT

    [ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240948#comment-14240948
] 

Varun Vasudev commented on YARN-2618:
-------------------------------------

Wei, Karthik, in the parent JIRA design docs, the model presented was that when an app asks
for vdisks as part of the resource allocation, what it's doing is asking for a portion of
the disk operations on the node. There's a section at the end on extending vdisks to include
spindles but it wasn't clear on how to extend it. If the vdisks in the Resource class represents
a share of disk operations, can we change the name in the Resource class as well to reflect
this(from vdisks to something else)?

> Avoid over-allocation of disk resources
> ---------------------------------------
>
>                 Key: YARN-2618
>                 URL: https://issues.apache.org/jira/browse/YARN-2618
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Wei Yan
>            Assignee: Wei Yan
>         Attachments: YARN-2618-1.patch, YARN-2618-2.patch, YARN-2618-3.patch, YARN-2618-4.patch,
YARN-2618-5.patch
>
>
> Subtask of YARN-2139. 
> This should include
> - Add API support for introducing disk I/O as the 3rd type resource.
> - NM should report this information to the RM
> - RM should consider this to avoid over-allocation



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message