Return-Path: X-Original-To: apmail-hadoop-yarn-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-yarn-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7F2C11024E for ; Thu, 14 Nov 2013 23:47:21 +0000 (UTC) Received: (qmail 43746 invoked by uid 500); 14 Nov 2013 23:47:21 -0000 Delivered-To: apmail-hadoop-yarn-issues-archive@hadoop.apache.org Received: (qmail 43697 invoked by uid 500); 14 Nov 2013 23:47:21 -0000 Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: yarn-issues@hadoop.apache.org Delivered-To: mailing list yarn-issues@hadoop.apache.org Received: (qmail 43689 invoked by uid 99); 14 Nov 2013 23:47:21 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 14 Nov 2013 23:47:21 +0000 Date: Thu, 14 Nov 2013 23:47:21 +0000 (UTC) From: "Karthik Kambatla (JIRA)" To: yarn-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (YARN-1028) Add FailoverProxyProvider like capability to RMProxy MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/YARN-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13823126#comment-13823126 ] Karthik Kambatla commented on YARN-1028: ---------------------------------------- I propose the following: # Introduce {[ipc.client.connect.retry.interval}} and set it to 1 second by default # Introduce {{yarn.resourcemanager.ha.failover-interval-ms}} with a default value of 1 second to capture how soon to failover. (Should we reuse {{yarn.resourcemanager.connect.retry-interval.ms}} for this also?) Based on this and the value of {{ipc.client.connect.max.retries}}, dynamically set {{ipc.client.connect.retry.interval}}. For example, for the default values of 1 second for failover-interval and 10 for max.retries, the {{ipc.client.connect.retry.interval}} becomes 100 ms. # The number of times to failover is to be bounded by {{yarn.resourcemanager.connect.max-wait.ms}} [~bikassaha], what do you think? > Add FailoverProxyProvider like capability to RMProxy > ---------------------------------------------------- > > Key: YARN-1028 > URL: https://issues.apache.org/jira/browse/YARN-1028 > Project: Hadoop YARN > Issue Type: Sub-task > Reporter: Bikas Saha > Assignee: Karthik Kambatla > Attachments: yarn-1028-1.patch, yarn-1028-draft-cumulative.patch > > > RMProxy layer currently abstracts RM discovery and implements it by looking up service information from configuration. Motivated by HDFS and using existing classes from Common, we can add failover proxy providers that may provide RM discovery in extensible ways. -- This message was sent by Atlassian JIRA (v6.1#6144)