hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karthik Kambatla (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1028) Add FailoverProxyProvider like capability to RMProxy
Date Mon, 02 Dec 2013 04:17:37 GMT

    [ https://issues.apache.org/jira/browse/YARN-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13836224#comment-13836224

Karthik Kambatla commented on YARN-1028:

[~xgong], thanks for the review. I have been working on another patch different from the first
one, and will try to wrap it up soon. 

bq. The function RMProxy::createRetryPolicy() need to make some changes. Otherwise, we need
to wait RESOURCEMANAGER_CONNECT_MAX_WAIT_MS(default is 15 mins) to try to connect next RM.
It might appear so, but the actual wait time is controlled by ipc.client.connect.max.retries,
which is 10 seconds by default. Verified it on a cluster.

bq. Maybe make ConfiguredFailoverProxyProvider as pluggable class ?
Good point. Will add that. 

> Add FailoverProxyProvider like capability to RMProxy
> ----------------------------------------------------
>                 Key: YARN-1028
>                 URL: https://issues.apache.org/jira/browse/YARN-1028
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Bikas Saha
>            Assignee: Karthik Kambatla
>         Attachments: yarn-1028-1.patch, yarn-1028-draft-cumulative.patch
> RMProxy layer currently abstracts RM discovery and implements it by looking up service
information from configuration. Motivated by HDFS and using existing classes from Common,
we can add failover proxy providers that may provide RM discovery in extensible ways.

This message was sent by Atlassian JIRA

View raw message