Return-Path: X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6B34272CB for ; Thu, 25 Aug 2011 18:44:34 +0000 (UTC) Received: (qmail 81987 invoked by uid 500); 25 Aug 2011 18:44:33 -0000 Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org Received: (qmail 81713 invoked by uid 500); 25 Aug 2011 18:44:32 -0000 Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-dev@hadoop.apache.org Delivered-To: mailing list common-dev@hadoop.apache.org Received: (qmail 81699 invoked by uid 99); 25 Aug 2011 18:44:32 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 25 Aug 2011 18:44:32 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of ajnelson@cs.ucsc.edu designates 128.114.48.10 as permitted sender) Received: from [128.114.48.10] (HELO services.cse.ucsc.edu) (128.114.48.10) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 25 Aug 2011 18:44:26 +0000 Received: from [10.1.0.57] (adsl-99-147-150-9.dsl.pltn13.sbcglobal.net [99.147.150.9]) (authenticated bits=0) by services.cse.ucsc.edu (8.13.6/8.13.6) with ESMTP id p7PIi3fi019521 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NO); Thu, 25 Aug 2011 11:44:03 -0700 (PDT) Subject: Re: Any related paper on how to resolve hadoop SPOF issue? Mime-Version: 1.0 (Apple Message framework v1244.3) Content-Type: text/plain; charset=iso-8859-1 From: Alex Nelson In-Reply-To: <4E561BED.2070101@mail.ntua.gr> Date: Thu, 25 Aug 2011 11:44:02 -0700 Cc: common-dev@hadoop.apache.org, common-user@hadoop.apache.org, Carlos Maltzahn Content-Transfer-Encoding: quoted-printable Message-Id: <4A9CE993-E752-43C3-A380-E62DEE28E8ED@cs.ucsc.edu> References: <4E56195B.8000200@mail.ntua.gr> <4E561BED.2070101@mail.ntua.gr> To: George Kousiouris X-Mailer: Apple Mail (2.1244.3) X-Virus-Checked: Checked by ClamAV on apache.org Hi George, UC Santa Cruz contributed a ;login: article describing replacing HDFS = with Ceph. (I was one of the authors.) One of the key architectural = advantages of Ceph over HDFS is that Ceph distributes its metadata = service over multiple metadata servers. I hope that helps. --Alex On Aug 25, 2011, at 02:54 , George Kousiouris wrote: >=20 > Hi, >=20 > many thanks!! >=20 > I also found this one, which has some related work also with other = efforts, in case it is helpful for someone else: > = https://ritdml.rit.edu/bitstream/handle/1850/13321/ATalwalkarThesis1-2011.= pdf?sequence=3D1 >=20 >=20 > BR, > George >=20 > On 8/25/2011 12:46 PM, Nan Zhu wrote: >> Hope it helps >>=20 >> http://www.springerlink.com/content/h17r882710314147/ >>=20 >> Best, >>=20 >> Nan >>=20 >> On Thu, Aug 25, 2011 at 5:43 PM, George = Kousiouriswrote: >>=20 >>> Hi guys, >>>=20 >>> We are currently in the process of writing a paper regarding hadoop = and we >>> would like to reference any attempt to remove the single point of = failure of >>> the Namenode. We have found in various presentations some efforts = (like >>> dividing the namespace between more than one namenodes if i remember >>> correctly) but the search for a concrete paper on the issue came to = nothing. >>>=20 >>> Is anyone aware or has participated in such an effort? >>>=20 >>> Thanks, >>> George >>>=20 >>> -- >>>=20 >>> --------------------------- >>>=20 >>> George Kousiouris >>> Electrical and Computer Engineer >>> Division of Communications, >>> Electronics and Information Engineering >>> School of Electrical and Computer Engineering >>> Tel: +30 210 772 2546 >>> Mobile: +30 6939354121 >>> Fax: +30 210 772 2569 >>> Email: gkousiou@mail.ntua.gr >>> Site: http://users.ntua.gr/gkousiou/ >>>=20 >>> National Technical University of Athens >>> 9 Heroon Polytechniou str., 157 73 Zografou, Athens, Greece >>>=20 >>>=20 >>=20 >=20 >=20 > --=20 >=20 > --------------------------- >=20 > George Kousiouris > Electrical and Computer Engineer > Division of Communications, > Electronics and Information Engineering > School of Electrical and Computer Engineering > Tel: +30 210 772 2546 > Mobile: +30 6939354121 > Fax: +30 210 772 2569 > Email: gkousiou@mail.ntua.gr > Site: http://users.ntua.gr/gkousiou/ >=20 > National Technical University of Athens > 9 Heroon Polytechniou str., 157 73 Zografou, Athens, Greece >=20