Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B533510622 for ; Thu, 17 Apr 2014 18:05:18 +0000 (UTC) Received: (qmail 32772 invoked by uid 500); 17 Apr 2014 18:05:15 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 32695 invoked by uid 500); 17 Apr 2014 18:05:15 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 32684 invoked by uid 99); 17 Apr 2014 18:05:15 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 17 Apr 2014 18:05:15 +0000 Date: Thu, 17 Apr 2014 18:05:15 +0000 (UTC) From: "Colin Patrick McCabe (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HDFS-6180) dead node count / listing is very broken in JMX and old GUI MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-6180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13973213#comment-13973213 ] Colin Patrick McCabe commented on HDFS-6180: -------------------------------------------- Thanks for fixing this, Haohui. {code} - @Test(timeout=360000) - public void testIncludeByRegistrationName() throws IOException, - InterruptedException { - Configuration hdfsConf = new Configuration(conf); - final String registrationName = "--registration-name--"; - final String nonExistentDn = "127.0.0.40"; - hdfsConf.set(DFSConfigKeys.DFS_DATANODE_HOST_NAME_KEY, registrationName); {code} This test got removed, but I don't see any corresponding test added of registration names (DFS_DATANODE_HOST_NAME_KEY). Was this an oversight? > dead node count / listing is very broken in JMX and old GUI > ----------------------------------------------------------- > > Key: HDFS-6180 > URL: https://issues.apache.org/jira/browse/HDFS-6180 > Project: Hadoop HDFS > Issue Type: Bug > Affects Versions: 2.3.0 > Reporter: Travis Thompson > Assignee: Haohui Mai > Priority: Blocker > Fix For: 2.5.0 > > Attachments: HDFS-6180.000.patch, HDFS-6180.001.patch, HDFS-6180.002.patch, HDFS-6180.003.patch, HDFS-6180.004.patch, dn.log > > > After bringing up a 578 node cluster with 13 dead nodes, 0 were reported on the new GUI, but showed up properly in the datanodes tab. Some nodes are also being double reported in the deadnode and inservice section (22 show up dead, 565 show up alive, 9 duplicated nodes). > From /jmx (confirmed that it's the same in jconsole): > {noformat} > { > "name" : "Hadoop:service=NameNode,name=FSNamesystemState", > "modelerType" : "org.apache.hadoop.hdfs.server.namenode.FSNamesystem", > "CapacityTotal" : 5477748687372288, > "CapacityUsed" : 24825720407, > "CapacityRemaining" : 5477723861651881, > "TotalLoad" : 565, > "SnapshotStats" : "{\"SnapshottableDirectories\":0,\"Snapshots\":0}", > "BlocksTotal" : 21065, > "MaxObjects" : 0, > "FilesTotal" : 25454, > "PendingReplicationBlocks" : 0, > "UnderReplicatedBlocks" : 0, > "ScheduledReplicationBlocks" : 0, > "FSState" : "Operational", > "NumLiveDataNodes" : 565, > "NumDeadDataNodes" : 0, > "NumDecomLiveDataNodes" : 0, > "NumDecomDeadDataNodes" : 0, > "NumDecommissioningDataNodes" : 0, > "NumStaleDataNodes" : 1 > }, > {noformat} > I'm not going to include deadnode/livenodes because the list is huge, but I've confirmed there are 9 nodes showing up in both deadnodes and livenodes. -- This message was sent by Atlassian JIRA (v6.2#6252)