Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 28C9E10E92 for ; Wed, 30 Oct 2013 13:13:10 +0000 (UTC) Received: (qmail 67313 invoked by uid 500); 30 Oct 2013 13:13:01 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 67150 invoked by uid 500); 30 Oct 2013 13:12:56 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 67125 invoked by uid 99); 30 Oct 2013 13:12:54 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 30 Oct 2013 13:12:54 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_QUOTING X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of brahmareddy.battula@huawei.com designates 119.145.14.66 as permitted sender) Received: from [119.145.14.66] (HELO szxga03-in.huawei.com) (119.145.14.66) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 30 Oct 2013 13:12:39 +0000 Received: from 172.24.2.119 (EHLO szxeml213-edg.china.huawei.com) ([172.24.2.119]) by szxrg03-dlp.huawei.com (MOS 4.4.3-GA FastPath queued) with ESMTP id AFZ25639; Wed, 30 Oct 2013 21:12:14 +0800 (CST) Received: from SZXEML416-HUB.china.huawei.com (10.82.67.155) by szxeml213-edg.china.huawei.com (172.24.2.30) with Microsoft SMTP Server (TLS) id 14.3.146.0; Wed, 30 Oct 2013 21:12:12 +0800 Received: from SZXEML510-MBX.china.huawei.com ([169.254.3.96]) by szxeml416-hub.china.huawei.com ([10.82.67.155]) with mapi id 14.03.0146.000; Wed, 30 Oct 2013 21:12:08 +0800 From: Brahma Reddy Battula To: "user@hadoop.apache.org" Subject: RE: Namenode doesn't accurately know datanodes free-space Thread-Topic: Namenode doesn't accurately know datanodes free-space Thread-Index: AQHO1MnTBb6hsWh0RE2cXlrhj/5SGpoNOUeE Date: Wed, 30 Oct 2013 13:12:07 +0000 Message-ID: <8AD4EE147886274A8B495D6AF407DF6923FEBE2A@szxeml510-mbx.china.huawei.com> References: In-Reply-To: Accept-Language: en-US, zh-CN Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.18.144.148] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-CFilter-Loop: Reflected X-Virus-Checked: Checked by ClamAV on apache.org Dear Alex """Has anyone else experienced this behavior?"""" Yes, I had also experienced and raised jira for same.. Please have look on following issue.. https://issues.apache.org/jira/browse/HDFS-5215 ________________________________________ From: alex bohr [alexjbohr@gmail.com] Sent: Wednesday, October 30, 2013 1:07 AM To: user@hadoop.apache.org Subject: Namenode doesn't accurately know datanodes free-space I see that the Namenode always reports datanodes as having about 5% more sp= ace then they actually do. And I recently added some smaller datanodes into the cluster and the drives= filled up to 100%, not respecting the 5GB I had reserved for Map Reduce wi= th this property from mapred-site.xml: dfs.datanode.du.reserved 5368709120 Has anyone else experienced this behavior?