Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 53907 invoked from network); 14 Nov 2008 01:19:14 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 14 Nov 2008 01:19:14 -0000 Received: (qmail 11869 invoked by uid 500); 14 Nov 2008 01:19:17 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 11814 invoked by uid 500); 14 Nov 2008 01:19:17 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 11803 invoked by uid 99); 14 Nov 2008 01:19:16 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 13 Nov 2008 17:19:16 -0800 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of slunati@gmail.com designates 64.233.170.190 as permitted sender) Received: from [64.233.170.190] (HELO rn-out-0910.google.com) (64.233.170.190) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 14 Nov 2008 01:17:57 +0000 Received: by rn-out-0910.google.com with SMTP id j71so1134108rne.12 for ; Thu, 13 Nov 2008 17:18:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:mime-version:content-type; bh=kGmT6NuylesYc4uizOCduvF+5gdOq7YUEqtJWKhKBq4=; b=E39mNlerEhTFcKRRsFbgWdwDhzEojiTaa71r+bhNEaLjHVnFTflh243wcaUC+UjXO3 7IEIpa1Y9M2YYo9/FtWj+k9+d5xFmv6aOUaM0VV2Psy5AAXI/KD14YTzBo26Z7iLHGep EKhgwxxpUqWerR1flTHt1uIZFvXtrfhInWXVc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type; b=YP+YKVIIFW4EUTQBN0YAaxZ5p5LbFr9GmQ/pBYdDuvqVxO+r+GLOBiUfX6jBYFdAtv 8h/4BnMN9sEylo60rMzoLIt1G+Lw89Yh0wXoBTTwlef0Vbo2tfjO93YdlHGpjJ5lf485 EtbKDNnonXhukj4ZTRl0gf7ziq1urkk1WbczM= Received: by 10.100.154.17 with SMTP id b17mr215964ane.155.1226625520885; Thu, 13 Nov 2008 17:18:40 -0800 (PST) Received: by 10.100.231.5 with HTTP; Thu, 13 Nov 2008 17:18:40 -0800 (PST) Message-ID: <2b94eb950811131718u7501f9b6w66db433abe6cbba5@mail.gmail.com> Date: Thu, 13 Nov 2008 17:18:40 -0800 From: S.L. To: core-user@hadoop.apache.org Subject: HDFS NameNode and HA: best strategy? MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_39916_30627761.1226625520827" X-Virus-Checked: Checked by ClamAV on apache.org ------=_Part_39916_30627761.1226625520827 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Content-Disposition: inline Hi list I am kind of new to Hadoop but have some good background. I am seriously considering adopting Hadoop and especially HDFS first to be able to store various files (in the low hundreds thousands at first) on a few nodes in a manner where I don't need a RAID system or a SAN. HDFS seems a perfect fit for the job... BUT from what I learn in the past couple days it seems that the single point of failure in HDFS is the NameNode. So I was wondering if anyone in the list that did deploy HDFS in a production environment on what is their strategy for High Availability of the system... Having the NameNode unavailable is basically bringing the whole HDFS system offline. So what are the scripts or other techniques recommended to add H.A to HDFS ! Thank ! -- S. ------=_Part_39916_30627761.1226625520827--