Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1887B10EC9 for ; Wed, 30 Apr 2014 12:20:55 +0000 (UTC) Received: (qmail 45759 invoked by uid 500); 30 Apr 2014 12:20:43 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 45330 invoked by uid 500); 30 Apr 2014 12:20:42 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 45322 invoked by uid 99); 30 Apr 2014 12:20:41 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 30 Apr 2014 12:20:41 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of harsh@cloudera.com designates 209.85.213.175 as permitted sender) Received: from [209.85.213.175] (HELO mail-ig0-f175.google.com) (209.85.213.175) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 30 Apr 2014 12:20:37 +0000 Received: by mail-ig0-f175.google.com with SMTP id h3so7472781igd.2 for ; Wed, 30 Apr 2014 05:20:16 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=q69394rMSrmvoJ3nMTgyjPpBZLuxmCH2sl/MwI5pXuI=; b=QF2ypv01E6RDo3po1NQvsvwI/dM3poT8BXx3xHV9QAEZQmPq3aWJ4IS3pl3mXsM3Kv DB5qZadnIXPYWcO8cJKPkvi27Nrmgj6YrTADDTiEKmk6wex82WorkvBNLDiwY/cEMmow WWp76RUC2Nlh4Tb7+UjDyY6e/JaKD5ENIFCONT2EUf2h7o/Txnuo5efV0uOf9szLxLbY RHVoDKAEoBDMlmXB7zSswVgeECFzy5pupURvbFk8VJ8UVT1tQsHPOiqVKvvjNMFTE5M4 oWwuVOgXZYsM4bYj7Pa1pW4d8sKzyZch1Pe+OEFRrd6U6ByuDuSeoNtSJhprD3yFTATZ P74g== X-Gm-Message-State: ALoCoQnJm1SvnA8WSiGBu16WtqC25mWMrRclr1Fyt56OArsQBaUGx4mCwzHQdrR6mzhzXXfykdpm X-Received: by 10.43.138.210 with SMTP id it18mr3334903icc.23.1398860414334; Wed, 30 Apr 2014 05:20:14 -0700 (PDT) MIME-Version: 1.0 Received: by 10.50.50.168 with HTTP; Wed, 30 Apr 2014 05:19:54 -0700 (PDT) In-Reply-To: References: From: Harsh J Date: Wed, 30 Apr 2014 17:49:54 +0530 Message-ID: Subject: Re: For QJM HA solution, after failover, application must update NameNode IP? To: "" Content-Type: text/plain; charset=UTF-8 X-Virus-Checked: Checked by ClamAV on apache.org Hi Sam, Bryan meant the last config bit: dfs.client.failover.proxy.provider.gilbert-prod org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider This is the class the client will use to perform the failover (i.e. active NN discovery). On Tue, Apr 29, 2014 at 7:37 PM, sam liu wrote: > Hi Bryan, > > Thanks for your detailed response! > > - 'you use a logical name for your "group of namenodes"': In your case, it > should be 'MYCLUSTER' > > - 'provide a means for the client to handle connecting to the currently > active one': Could you pls give an example? > > > > > 2014-04-29 21:57 GMT+08:00 Bryan Beaudreault : > >> If you are using the QJM HA solution, the IP addresses of the namenodes >> should not change. Instead your clients should be connecting using the >> proper HA configurations. That is, you use a logical name for your "group >> of namenodes", and provide a means for the client to handle connecting to >> the currently active one. >> >> Example: >> >> >> dfs.nameservices >> MYCLUSTER >> >> >> >> dfs.ha.namenodes.MYCLUSTER >> nn1,nn2 >> >> >> >> dfs.namenode.rpc-address.MYCLUSTER.nn1 >> dnsOfNameNode1:8020 >> >> >> dfs.namenode.http-address.MYCLUSTER.nn1 >> dnsOfNameNode1:50070 >> >> >> >> dfs.namenode.rpc-address.MYCLUSTER.nn2 >> dnsOfNameNode2:8020 >> >> >> dfs.namenode.http-address.MYCLUSTER.nn2 >> dnsOfNameNode2:50070 >> >> >> >> dfs.client.failover.proxy.provider.gilbert-prod >> >> org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider >> >> >> >> On Tue, Apr 29, 2014 at 9:07 AM, sam liu wrote: >>> >>> Hi Experts, >>> >>> For example, at the beginning, the application will access NameNode using >>> IP of active NameNode(IP: 9.123.22.1). However, after failover, the IP of >>> active NameNode is changed to 9.123.22.2 which is the IP of previous standby >>> NameNode. In this case, application must update NameNode IP? >>> >>> Thanks! >> >> > -- Harsh J