hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuan Gong (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1028) Add FailoverProxyProvider like capability to RMProxy
Date Tue, 03 Dec 2013 01:41:36 GMT

    [ https://issues.apache.org/jira/browse/YARN-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13837218#comment-13837218

Xuan Gong commented on YARN-1028:

Yes, I agree with [~jianhe]. We did make such assumption. Basically, whether or which retry
policy it will choose is based on the exceptions. In HA case, I think that we do not need
to wrap with RetryPolicies.retryByException. Just directly return with RetryPolicies.failoverOnNetworkException
should be enough. Otherwise, we will only retry for connectionException and IOException. But
if we directly use RetryPolicies.failoverOnNetworkException, it will consider much more exceptions.
Take a look at FailoverOnNetworkExceptionRetry::shouldRetry(). we can find more exceptions
that this retryPolicy can handle.

> Add FailoverProxyProvider like capability to RMProxy
> ----------------------------------------------------
>                 Key: YARN-1028
>                 URL: https://issues.apache.org/jira/browse/YARN-1028
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Bikas Saha
>            Assignee: Karthik Kambatla
>         Attachments: yarn-1028-1.patch, yarn-1028-draft-cumulative.patch
> RMProxy layer currently abstracts RM discovery and implements it by looking up service
information from configuration. Motivated by HDFS and using existing classes from Common,
we can add failover proxy providers that may provide RM discovery in extensible ways.

This message was sent by Atlassian JIRA

View raw message