hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tao Jie (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-5636) Support reserving resources on certain nodes for certain applications
Date Mon, 12 Sep 2016 02:36:20 GMT
Tao Jie created YARN-5636:

             Summary: Support reserving resources on certain nodes for certain applications
                 Key: YARN-5636
                 URL: https://issues.apache.org/jira/browse/YARN-5636
             Project: Hadoop YARN
          Issue Type: Improvement
          Components: scheduler
            Reporter: Tao Jie

We have met such circumstance:
We are trying to run storm&kafka on yarn by Slider, and Storm&Kafka writes data to
local disk on node. If some containers or the application fails, we expect that those containers
would restart on the same node as they run before, otherwise data written on local would lost.
For slider, it will trying to ensure restarted container on same nodes as before. However
for yarn, resource may be assigned to other applications when former long-running application
is down.
As a result we'd better to have a mechanism that reserve some resource for certain long-running
applications on certain nodes for a period of time. Does it make sense?

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message