hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jiandan Yang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5636) Support reserving resources on certain nodes for certain applications
Date Tue, 12 Dec 2017 07:40:02 GMT

    [ https://issues.apache.org/jira/browse/YARN-5636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16287229#comment-16287229

Jiandan Yang  commented on YARN-5636:

[~Tao Jie] I think you solution is good. You can provide a patch to review.

> Support reserving resources on certain nodes for certain applications
> ---------------------------------------------------------------------
>                 Key: YARN-5636
>                 URL: https://issues.apache.org/jira/browse/YARN-5636
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: scheduler
>            Reporter: Tao Jie
> We have met such circumstance:
> We are trying to run storm&kafka on yarn by Slider, and Storm&Kafka writes data
to local disk on node. If some containers or the application fails, we expect that those containers
would restart on the same node as they run before, otherwise data written on local would lost.
> For slider, it will trying to ensure restarted container on same nodes as before. However
for yarn, resource may be assigned to other applications when former long-running application
is down.
> As a result we'd better to have a mechanism that reserve some resource for certain long-running
applications on certain nodes for a period of time. Does it make sense?

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message