From yarn-issues-return-18305-apmail-hadoop-yarn-issues-archive=hadoop.apache.org@hadoop.apache.org Fri Nov 15 00:37:20 2013 Return-Path: X-Original-To: apmail-hadoop-yarn-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-yarn-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A6F9C1044F for ; Fri, 15 Nov 2013 00:37:20 +0000 (UTC) Received: (qmail 12658 invoked by uid 500); 15 Nov 2013 00:37:20 -0000 Delivered-To: apmail-hadoop-yarn-issues-archive@hadoop.apache.org Received: (qmail 12629 invoked by uid 500); 15 Nov 2013 00:37:20 -0000 Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: yarn-issues@hadoop.apache.org Delivered-To: mailing list yarn-issues@hadoop.apache.org Received: (qmail 12620 invoked by uid 99); 15 Nov 2013 00:37:20 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 15 Nov 2013 00:37:20 +0000 Date: Fri, 15 Nov 2013 00:37:20 +0000 (UTC) From: "Karthik Kambatla (JIRA)" To: yarn-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (YARN-1028) Add FailoverProxyProvider like capability to RMProxy MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/YARN-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13823164#comment-13823164 ] Karthik Kambatla commented on YARN-1028: ---------------------------------------- When running a cluster with the patch (yarn-1028-1.patch), clients failover. However, they take 10 seconds (try the same RM 10 times every second) before they try the other RM. This hurts performance significantly - would be nice to have knobs to turn that down and even better if it takes little time to failover by default. Does that explain the problem? > Add FailoverProxyProvider like capability to RMProxy > ---------------------------------------------------- > > Key: YARN-1028 > URL: https://issues.apache.org/jira/browse/YARN-1028 > Project: Hadoop YARN > Issue Type: Sub-task > Reporter: Bikas Saha > Assignee: Karthik Kambatla > Attachments: yarn-1028-1.patch, yarn-1028-draft-cumulative.patch > > > RMProxy layer currently abstracts RM discovery and implements it by looking up service information from configuration. Motivated by HDFS and using existing classes from Common, we can add failover proxy providers that may provide RM discovery in extensible ways. -- This message was sent by Atlassian JIRA (v6.1#6144)