Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 89652 invoked from network); 15 Apr 2008 00:17:10 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 15 Apr 2008 00:17:10 -0000 Received: (qmail 83394 invoked by uid 500); 15 Apr 2008 00:17:07 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 83361 invoked by uid 500); 15 Apr 2008 00:17:07 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 83351 invoked by uid 99); 15 Apr 2008 00:17:07 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 14 Apr 2008 17:17:07 -0700 X-ASF-Spam-Status: No, hits=2.0 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of michael@powerset.com designates 207.5.72.95 as permitted sender) Received: from [207.5.72.95] (HELO EXHUB015-3.exch015.msoutlookonline.net) (207.5.72.95) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Apr 2008 00:16:22 +0000 Received: from EXVMBX015-1.exch015.msoutlookonline.net ([207.5.72.71]) by EXHUB015-3.exch015.msoutlookonline.net ([207.5.72.95]) with mapi; Mon, 14 Apr 2008 17:16:34 -0700 From: Michael Bieniosek To: Cagdas Gerede , "core-user@hadoop.apache.org" Date: Mon, 14 Apr 2008 17:16:06 -0700 Subject: Re: How often Name node fails? Thread-Topic: How often Name node fails? Thread-Index: AciefQUUhBSELuQaTOaLHDJdc4MBAwAEOCJl Message-ID: In-Reply-To: <4cc657e40804141514w7b518801ha0542c013a9a56e@mail.gmail.com> Accept-Language: en-US Content-Language: en X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: multipart/alternative; boundary="_000_C42941D62FCA1michaelpowersetcom_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_C42941D62FCA1michaelpowersetcom_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable >From my experience, the namenode almost never crashes. It does use a lot o= f RAM, but not nearly as much as it used to. You might have problems if yo= u have many many small files (maybe 100,000s?). I have had more problems with datanode failures, particularly when there is= mapreduce-generated load on the machines running the datanodes. -Michael On 4/14/08 3:14 PM, "Cagdas Gerede" wrote: >From your experience with Hadoop Distributed File System, how reliable is the namenode? How often does it fail? Are there mechanisms developed outside of Hadoop to make namenode more fault tolerant? Thanks for your feedback, -- ------------ Best Regards, Cagdas Evren Gerede Home Page: http://cagdasgerede.info --_000_C42941D62FCA1michaelpowersetcom_--