Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 05065902B for ; Sun, 20 Nov 2011 04:51:16 +0000 (UTC) Received: (qmail 10351 invoked by uid 500); 20 Nov 2011 04:51:15 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 10283 invoked by uid 500); 20 Nov 2011 04:51:14 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 10275 invoked by uid 99); 20 Nov 2011 04:51:13 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 20 Nov 2011 04:51:13 +0000 X-ASF-Spam-Status: No, hits=-2001.2 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 20 Nov 2011 04:51:11 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id BAF3F913CD for ; Sun, 20 Nov 2011 04:50:51 +0000 (UTC) Date: Sun, 20 Nov 2011 04:50:51 +0000 (UTC) From: "Harsh J (Commented) (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: <751429449.48364.1321764651767.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <1477157205.48264.1321762191611.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HDFS-2569) DN decommissioning quirks MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13153701#comment-13153701 ] Harsh J commented on HDFS-2569: ------------------------------- Restarting DN, makes it join back the cluster. No disallow exception is presented. > DN decommissioning quirks > ------------------------- > > Key: HDFS-2569 > URL: https://issues.apache.org/jira/browse/HDFS-2569 > Project: Hadoop HDFS > Issue Type: Bug > Components: data-node > Affects Versions: 0.23.0 > Reporter: Harsh J > Assignee: Harsh J > > Decommissioning a node is working slightly odd in 0.23+: > The steps I did: > - Start HDFS via {{hdfs namenode}} and {{hdfs datanode}}. 1-node cluster. > - Zero files/blocks, so I go ahead and exclude-add my DN and do {{hdfs dfsadmin -refreshNodes}} > - I see the following log in NN tails, which is fine: > {code} > 11/11/20 09:28:10 INFO util.HostsFileReader: Setting the includes file to > 11/11/20 09:28:10 INFO util.HostsFileReader: Setting the excludes file to build/test/excludes > 11/11/20 09:28:10 INFO util.HostsFileReader: Refreshing hosts (include/exclude) list > 11/11/20 09:28:10 INFO util.HostsFileReader: Adding 192.168.1.23 to the list of hosts from build/test/excludes > {code} > - However, DN log tail gets no new messages. DN still runs. > - The dfshealth.jsp page shows this table, which makes no sense -- why is there 1 live and 1 dead?: > |Live Nodes|1 (Decommissioned: 1)| > |Dead Nodes|1 (Decommissioned: 0)| > |Decommissioning Nodes|0| > - The live nodes page shows this, meaning DN is still up and heartbeating but is decommissioned: > |Node|Last Contact|Admin State| > |192.168.1.23|0|Decommissioned| > - The dead nodes page shows this, and the link to the DN is broken cause the port is linked as -1. Also, showing 'false' for decommissioned makes no sense when live node page shows that it is already decommissioned: > |Node|Decommissioned| > |192.168.1.23|false| > Investigating if this is a quirk only observed when the DN had 0 blocks on it in sum total. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira