hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhaohui Xin (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-9276) Filter non-existent resource requests actively
Date Sun, 03 Feb 2019 06:59:00 GMT

     [ https://issues.apache.org/jira/browse/YARN-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Zhaohui Xin updated YARN-9276:
------------------------------
    Description: 
In some scenarios, applications will request nonexistent resource name in this cluster, such
as nonexistent hosts or racks.

Obviously, we should filter or degrade these invaild resource requests actively.

*This is especially effective when HDFS and Yarn are deployed on different nodes, and the
scheduling throughput of one of our clusters has improved by {color:#FF0000}5X{color}.*

 

 

  was:
In some scenarios, applications will request nonexistent resource name in this cluster, such
as nonexistent hosts or racks.

Obviously, we should filter or degrade these invaild resource requests actively.

This is especially effective when HDFS and Yarn are deployed on different nodes, and the scheduling
throughput of one of our clusters has improved by 5X.


> Filter non-existent resource requests actively
> ----------------------------------------------
>
>                 Key: YARN-9276
>                 URL: https://issues.apache.org/jira/browse/YARN-9276
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: RM, scheduler
>    Affects Versions: 2.6.0, 2.7.0, 2.8.0, 2.9.0, 3.0.0, 3.1.0
>            Reporter: Zhaohui Xin
>            Assignee: Zhaohui Xin
>            Priority: Major
>         Attachments: image-2019-02-03-14-58-31-246.png, image-2019-02-03-14-58-48-148.png
>
>
> In some scenarios, applications will request nonexistent resource name in this cluster,
such as nonexistent hosts or racks.
> Obviously, we should filter or degrade these invaild resource requests actively.
> *This is especially effective when HDFS and Yarn are deployed on different nodes, and
the scheduling throughput of one of our clusters has improved by {color:#FF0000}5X{color}.*
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message