Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6567010E43 for ; Wed, 19 Mar 2014 12:09:09 +0000 (UTC) Received: (qmail 99446 invoked by uid 500); 19 Mar 2014 12:08:59 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 99030 invoked by uid 500); 19 Mar 2014 12:08:58 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 99022 invoked by uid 99); 19 Mar 2014 12:08:57 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 19 Mar 2014 12:08:57 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of rohithsharmaks@huawei.com designates 119.145.14.64 as permitted sender) Received: from [119.145.14.64] (HELO szxga01-in.huawei.com) (119.145.14.64) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 19 Mar 2014 12:08:53 +0000 Received: from 172.24.2.119 (EHLO szxeml206-edg.china.huawei.com) ([172.24.2.119]) by szxrg01-dlp.huawei.com (MOS 4.3.7-GA FastPath queued) with ESMTP id BSV49132; Wed, 19 Mar 2014 20:08:30 +0800 (CST) Received: from SZXEML451-HUB.china.huawei.com (10.82.67.194) by szxeml206-edg.china.huawei.com (172.24.2.59) with Microsoft SMTP Server (TLS) id 14.3.158.1; Wed, 19 Mar 2014 20:08:02 +0800 Received: from SZXEML512-MBS.china.huawei.com ([169.254.8.221]) by szxeml451-hub.china.huawei.com ([10.82.67.194]) with mapi id 14.03.0158.001; Wed, 19 Mar 2014 20:08:15 +0800 From: Rohith Sharma K S To: "user@hadoop.apache.org" Subject: RE: NodeHealthReport local-dirs turned bad Thread-Topic: NodeHealthReport local-dirs turned bad Thread-Index: AQHPQ2c9nNwxTV1uOEWV9lDG7iBvwproTtjw Date: Wed, 19 Mar 2014 12:08:13 +0000 Message-ID: <0EE80F6F7A98A64EBD18F2BE839C911567531399@szxeml512-mbs.china.huawei.com> References: <532980A2.40106@roo.ee> In-Reply-To: <532980A2.40106@roo.ee> Accept-Language: en-US, zh-CN Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.18.168.138] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-CFilter-Loop: Reflected X-Virus-Checked: Checked by ClamAV on apache.org Hi There is no relation to NameNode format!!!! Does NodeManger is started with default configuration? If no , any NodeMang= er health script is configured? Suspect can be =20 1. /hadoop does not have permission or=20 2. disk is full!!!! Thanks & Regards Rohith Sharma K S -----Original Message----- From: Margusja [mailto:margus@roo.ee]=20 Sent: 19 March 2014 17:04 To: user@hadoop.apache.org Subject: NodeHealthReport local-dirs turned bad Hi I have one node in unhealthy status: =09 Total Vmem allocated for Containers 4.20 GB Vmem enforcement enabled false Total Pmem allocated for Container 2 GB Pmem enforcement enabled false NodeHealthyStatus false LastNodeHealthTime Wed Mar 19 13:31:24 EET 2014 NodeHealthReport 1/1 local-dirs turned bad: /hadoop/yarn/local;1/1=20 log-dirs turned bad: /hadoop/yarn/log Node Manager Version: 2.2.0.2.0.6.0-101 from=20 b07b2906c36defd389c8b5bd22bebc1bead8115b by jenkins source checksum 82bd166aa0ada92b44f8a154836b92 on 2014-01-09T05:24Z Hadoop Version: 2.2.0.2.0.6.0-101 from=20 b07b2906c36defd389c8b5bd22bebc1bead8115b by jenkins source checksum 704f1e463ebc4fb89353011407e965 on 2014-01-09T05:18Z I tried: Deleted /hadoop/* and did namenode -format again Restarted nodemanager but = still in unhealthy mode. Is there any guideline what I should do? -- Best regards, Margus (Margusja) Roo +372 51 48 780 http://margus.roo.ee http://ee.linkedin.com/in/margusroo skype: margusja ldapsearch -x -h ldap.sk.ee -b c=3DEE "(serialNumber=3D37303140314)"