hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-8697) LocalityMulticastAMRMProxyPolicy should fallback to random sub-cluster when cannot resolve resource
Date Tue, 28 Aug 2018 23:27:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-8697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16595725#comment-16595725
] 

Hudson commented on YARN-8697:
------------------------------

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14854 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/14854/])
YARN-8697. LocalityMulticastAMRMProxyPolicy should fallback to random (gifuma: rev 7ed458b255e492fd5bc2ca36f216ff1b16054db7)
* (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/federation/policies/amrmproxy/LocalityMulticastAMRMProxyPolicy.java
* (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/test/java/org/apache/hadoop/yarn/server/federation/policies/amrmproxy/TestLocalityMulticastAMRMProxyPolicy.java


> LocalityMulticastAMRMProxyPolicy should fallback to random sub-cluster when cannot resolve
resource
> ---------------------------------------------------------------------------------------------------
>
>                 Key: YARN-8697
>                 URL: https://issues.apache.org/jira/browse/YARN-8697
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Botong Huang
>            Assignee: Botong Huang
>            Priority: Major
>             Fix For: 3.2.0
>
>         Attachments: YARN-8697.v1.patch, YARN-8697.v2.patch
>
>
> Right now in LocalityMulticastAMRMProxyPolicy, whenever we cannot resolve the resource
name (node or rack), we always route the request to home sub-cluster. However, home sub-cluster
might not be always be ready to use (timed out YARN-8581) or enabled (by AMRMProxyPolicy weights).
It might also be overwhelmed by the requests if sub-cluster resolver has some issue. In this
Jira, we are changing it to pick a random active and enabled sub-cluster for resource request
we cannot resolve. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message