Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0534ED0E0 for ; Wed, 5 Sep 2012 03:42:01 +0000 (UTC) Received: (qmail 33833 invoked by uid 500); 5 Sep 2012 03:41:56 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 33411 invoked by uid 500); 5 Sep 2012 03:41:52 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 33383 invoked by uid 99); 5 Sep 2012 03:41:50 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Sep 2012 03:41:50 +0000 X-ASF-Spam-Status: No, hits=0.0 required=5.0 tests=FSL_RCVD_USER,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of kwiley@keithwiley.com designates 67.18.59.3 as permitted sender) Received: from [67.18.59.3] (HELO gateway05.websitewelcome.com) (67.18.59.3) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Sep 2012 03:41:42 +0000 Received: by gateway05.websitewelcome.com (Postfix, from userid 5007) id C469112D7125C; Tue, 4 Sep 2012 22:41:20 -0500 (CDT) Received: from gator542.hostgator.com (gator542.hostgator.com [74.54.187.114]) by gateway05.websitewelcome.com (Postfix) with ESMTP id B9EDD12D71233 for ; Tue, 4 Sep 2012 22:41:20 -0500 (CDT) Received: from [24.19.6.8] (port=47866 helo=[192.168.10.2]) by gator542.hostgator.com with esmtpa (Exim 4.77) (envelope-from ) id 1T96US-00020c-BI for user@hadoop.apache.org; Tue, 04 Sep 2012 22:41:20 -0500 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Apple Message framework v1084) Subject: Re: could only be replicated to 0 nodes, instead of 1 From: Keith Wiley In-Reply-To: Date: Tue, 4 Sep 2012 20:41:19 -0700 Content-Transfer-Encoding: quoted-printable Message-Id: <44378717-662E-4BE0-A0E2-EFADD663E6A4@keithwiley.com> References: <214B1B04-CE25-4774-8197-736EC72BAD27@keithwiley.com> <30465A92-E539-4635-A21F-15B2C6527214@keithwiley.com> To: user@hadoop.apache.org X-Mailer: Apple Mail (2.1084) X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - gator542.hostgator.com X-AntiAbuse: Original Domain - hadoop.apache.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - keithwiley.com X-BWhitelist: no X-Source: X-Source-Args: X-Source-Dir: X-Source-Sender: ([192.168.10.2]) [24.19.6.8]:47866 X-Source-Auth: kwiley+keithwiley.com X-Email-Count: 1 X-Source-Cap: a2J3aWxleTtrYndpbGV5O2dhdG9yNTQyLmhvc3RnYXRvci5jb20= Good to know. The bottom line is I was really short-roping everything = on resources. I just need to jack the machine up some. Thanks. On Sep 4, 2012, at 19:41 , Harsh J wrote: > Keith, >=20 > The NameNode has a resource-checker thread in it by design to help > prevent cases of on-disk metadata corruption in event of filled up > dfs.namenode.name.dir disks, etc.. By default, an NN will lock itself > up if the free disk space (among its configured metadata mounts) > reaches a value < 100 MB, controlled by > dfs.namenode.resource.du.reserved. You can probably set that to 0 if > you do not want such an automatic preventive measure. Its not exactly > a need, just a check to help avoid accidental data loss due to > non-monitoring of disk space. >=20 > On Tue, Sep 4, 2012 at 11:33 PM, Keith Wiley = wrote: >> I had moved the data directory to the larger disk but left the = namenode directory on the smaller disk figuring it didn't need much = room. Moving that to the larger disk seems to have improved the = situation...although I'm still surprised the NN needed so much room. >>=20 >> Problem is solved for now. >>=20 >>=20 >> Thanks. >> = __________________________________________________________________________= ______ >> Keith Wiley kwiley@keithwiley.com keithwiley.com = music.keithwiley.com >>=20 >> "I used to be with it, but then they changed what it was. Now, what = I'm with >> isn't it, and what's it seems weird and scary to me." >> -- Abe (Grandpa) Simpson >> = __________________________________________________________________________= ______ >>=20 >=20 >=20 >=20 > --=20 > Harsh J = __________________________________________________________________________= ______ Keith Wiley kwiley@keithwiley.com keithwiley.com = music.keithwiley.com "You can scratch an itch, but you can't itch a scratch. Furthermore, an = itch can itch but a scratch can't scratch. Finally, a scratch can itch, but an = itch can't scratch. All together this implies: He scratched the itch from the = scratch that itched but would never itch the scratch from the itch that scratched." -- Keith Wiley = __________________________________________________________________________= ______