Return-Path: Delivered-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Received: (qmail 64153 invoked from network); 12 Mar 2011 18:05:18 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 12 Mar 2011 18:05:18 -0000 Received: (qmail 21630 invoked by uid 500); 12 Mar 2011 18:05:18 -0000 Delivered-To: apmail-hadoop-hdfs-dev-archive@hadoop.apache.org Received: (qmail 21566 invoked by uid 500); 12 Mar 2011 18:05:18 -0000 Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-dev@hadoop.apache.org Delivered-To: mailing list hdfs-dev@hadoop.apache.org Delivered-To: moderator for hdfs-dev@hadoop.apache.org Received: (qmail 78987 invoked by uid 99); 12 Mar 2011 16:41:45 -0000 X-ASF-Spam-Status: No, hits=-2.3 required=5.0 tests=RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of awittenauer@linkedin.com designates 69.28.149.24 as permitted sender) DomainKey-Signature: s=prod; d=linkedin.com; c=nofws; q=dns; h=X-IronPort-AV:Received:From:To:Subject:Thread-Topic: Thread-Index:Date:Message-ID:References:In-Reply-To: Accept-Language:Content-Language:X-MS-Has-Attach: X-MS-TNEF-Correlator:x-originating-ip:Content-Type: Content-ID:Content-Transfer-Encoding:MIME-Version; b=AgxuA55VhEaImcb6pLqPTtoAaRtwjgqq7Lt59yhPLsO4h28dHaaANiaO Qmg/ut2k65ObpUiwwc+o2pNqUvT0PIHTCQI8kCTaWLBd2NvQzdQC4R7M3 RaH0BTWKqlGTCkV; DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linkedin.com; i=awittenauer@linkedin.com; q=dns/txt; s=proddkim; t=1299948099; x=1331484099; h=from:sender:reply-to:subject:date:message-id:to:cc: mime-version:content-transfer-encoding:content-id: content-description:resent-date:resent-from:resent-sender: resent-to:resent-cc:resent-message-id:in-reply-to: references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:list-owner:list-archive; z=From:=20Allen=20Wittenauer=20 |Subject:=20Re:=20Merging=20Namenode=20Federation=20featu re=20(HDFS-1052)=20to=20trunk|Date:=20Sat,=2012=20Mar=202 011=2016:43:23=20+0000|Message-ID:=20<55FE8C60-D827-45CF- 94EE-B258187A52C8@linkedin.com>|To:=20""=20|MIME-Version: =201.0|Content-Transfer-Encoding:=20quoted-printable |Content-ID:=20<00FC0EDAC45E724BACC90EA1CAE08F15@linkedin .com>|In-Reply-To:=20|References:=20; bh=NFNRL5DXaSbkHW8vtaTr0P7rYtylKAA+bG7joVCh0VM=; b=pMcsFLlroCSkx74cmA+cD4cpxjX/kXred9KFaosea+ygvyii4xFxcB1W JDWHVZK9R2lF/6DS0GJe9g3x+2s60N1gdFXx313rItC34mBGSuaMr9jKw /pqGkp9I5kwHFor; X-IronPort-AV: E=Sophos;i="4.62,308,1297065600"; d="scan'208";a="21624908" From: Allen Wittenauer To: "" Subject: Re: Merging Namenode Federation feature (HDFS-1052) to trunk Thread-Topic: Merging Namenode Federation feature (HDFS-1052) to trunk Thread-Index: AcvZ9CB16UWsveqe70CVthPzv2UUWAHIzvgA Date: Sat, 12 Mar 2011 16:43:23 +0000 Message-ID: <55FE8C60-D827-45CF-94EE-B258187A52C8@linkedin.com> References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [172.18.46.247] Content-Type: text/plain; charset="us-ascii" Content-ID: <00FC0EDAC45E724BACC90EA1CAE08F15@linkedin.com> Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org On Mar 3, 2011, at 2:41 PM, Suresh Srinivas wrote: > We have started pushing changes for namenode federation in to the feature= branch HDFS-1052. The work items are created as subtask of the jira HDFS-1= 052 and are based on the design document published in the same jira. By the= end of this week, we will complete pushing the changes to HDFS-1052 branch= . Though the changes in these jiras are already committed, please do provid= e your feedback on either HDFS-1052 or its subtasks. New items that come ou= t of the feedback will be addressed in new jiras. >=20 > Current status of the development: > # The testing of this feature is underway. Most of the basic functionalit= y has been tested both for a single namenode cluster (for backward compatib= ility) and with multiple namenodes. > # All the existing tests and newly added tests pass (same as trunk). >=20 > We plan on merging this branch to trunk after a week or two. This will he= lp us continue make future changes on the trunk. I will send an announcemen= t before merging the federation branch into trunk. >=20 It sounds like merging into trunk is extremely premature. That said, I'm = still trying to understand the why's around this. To me, this series of changes looks like it is going to make running a gri= d much much harder for very little benefit. In particular, I don't see the= difference between running multiple NN/DN combinations verses running fede= ration, especially with client side mount tables in play.