Return-Path: X-Original-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5CF579B63 for ; Wed, 7 Mar 2012 09:12:35 +0000 (UTC) Received: (qmail 74760 invoked by uid 500); 7 Mar 2012 09:12:34 -0000 Delivered-To: apmail-hadoop-hdfs-dev-archive@hadoop.apache.org Received: (qmail 74491 invoked by uid 500); 7 Mar 2012 09:12:33 -0000 Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-dev@hadoop.apache.org Delivered-To: mailing list hdfs-dev@hadoop.apache.org Received: (qmail 74470 invoked by uid 99); 7 Mar 2012 09:12:32 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 07 Mar 2012 09:12:32 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [209.85.220.176] (HELO mail-vx0-f176.google.com) (209.85.220.176) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 07 Mar 2012 09:12:27 +0000 Received: by vcbfl17 with SMTP id fl17so7385972vcb.35 for ; Wed, 07 Mar 2012 01:12:06 -0800 (PST) MIME-Version: 1.0 Received: by 10.52.173.230 with SMTP id bn6mr1908678vdc.19.1331111525946; Wed, 07 Mar 2012 01:12:05 -0800 (PST) Received: by 10.220.185.196 with HTTP; Wed, 7 Mar 2012 01:12:05 -0800 (PST) In-Reply-To: References: Date: Wed, 7 Mar 2012 01:12:05 -0800 Message-ID: Subject: Re: Merge Namenode HA feature to 0.23 From: Suresh Srinivas To: hdfs-dev@hadoop.apache.org Content-Type: multipart/alternative; boundary=bcaec51b1b3ba9139704baa38d47 X-Gm-Message-State: ALoCoQl0cPw2LFm/Pb3UzIxtkbTTQiWn5ZGItInIbWQjepyJDH3pTKufqFYrATXUn2Ob/4+cZz7q X-Virus-Checked: Checked by ClamAV on apache.org --bcaec51b1b3ba9139704baa38d47 Content-Type: text/plain; charset=ISO-8859-1 Thanks Eli for the list. I have merged the bugs you identified to 0.23. I am in the process of merging HA change. I have several conflicts, stemming from the changes that are no in 0.23. Pushing following jiras to 0.23 will make the merge easier. I believe these are mostly straight forward changes: HADOOP-7557 Make IPC header be extensible HDFS-3003. Remove getHostPortString() from NameNode, replace it with NetUtils.getHostPortString(). HADOOP-8108. Move method getHostPortString() from NameNode to NetUtils. HDFS-2764. TestBackupNode is racy. HDFS-2430. The number of failed or low-resource volumes the NN can tolerate should be configurable. HADOOP-7358. Improve log levels when exceptions caught in RPC handler. HDFS-2410. Further cleanup of hardcoded configuration keys and values. HDFS-2285. BackupNode should reject requests to modify namespace. HADOOP-7729. Send back valid HTTP response if user hits IPC port with HTTP GET. HADOOP-7717. Move handling of concurrent client fail-overs to RetryInvocationHandler If no one gets back to me in a day, I will start merging these to 0.23. On Sun, Mar 4, 2012 at 9:43 AM, Eli Collins wrote: > Hey Suresh, > > +1 Sounds great. Thanks for volunteering! > > You'll probably want to merge HDFS-1580, HDFS-1765, HDFS-2158, > HDFS-2188, HDFS-2334, HDFS-2476, HDFS-2477, and HDFS-2495 to branch-23 > first as these conflict and the patch will contain a bunch of non-HA > stuff. > > Thanks, > Eli > > On Fri, Mar 2, 2012 at 6:15 PM, Suresh Srinivas > wrote: > > Namenode HA (HDFS-1623) feature is now in trunk (yay!). It adds support > for > > namenode high availability with active and standby namenodes, with manual > > failover. I propose merging this feature to 0.23 branch. Recently > Nicholas > > merged protocol buffers/wire compatibility changes to 0.23. Merging > > Namenode HA into 0.23 will make it a significant release. > > > > I plan to complete this by next week after running some > nightly/regressions > > tests. Early next week, I plan to attach a 0.23 merge patch to HDFS-1623 > > jira for people interested in reviewing the patch. > > > > Please vote. > > > > Regards, > > Suresh > --bcaec51b1b3ba9139704baa38d47--