hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Virajith Jalaparti (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HDFS-12605) [READ] TestNameNodeProvidedImplementation#testProvidedDatanodeFailures fails after rebase
Date Fri, 06 Oct 2017 00:27:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-12605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16193961#comment-16193961
] 

Virajith Jalaparti edited comment on HDFS-12605 at 10/6/17 12:26 AM:
---------------------------------------------------------------------

The patch fixes the failing test case by adding the PROVIDED storage type to the {{DFSTopologyNodeImpl}}.

One thing I noticed in the test case was that the 2nd DN stopped was different from the datanode
passed to {{BlockManagerTestUtil.noticeDeadDatanode}}. This lead to the NN thinking the DN
was dead even though the DN was alive and continues to heart beat to the NN. As a result,
the ProvidedStorageInfo was marked as FAILED, and is never set back to NORMAL again. This
issue will be fixed in HDFS-12607.


was (Author: virajith):
The patch fixes the failing test case by adding the PROVIDED storage type to the {{DFSTopologyNodeImpl}}

> [READ] TestNameNodeProvidedImplementation#testProvidedDatanodeFailures fails after rebase
> -----------------------------------------------------------------------------------------
>
>                 Key: HDFS-12605
>                 URL: https://issues.apache.org/jira/browse/HDFS-12605
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Virajith Jalaparti
>            Assignee: Virajith Jalaparti
>         Attachments: HDFS-12605-HDFS-9806.001.patch
>
>
> {{TestNameNodeProvidedImplementation#testProvidedDatanodeFailures}} fails after rebase
with the following error:
> {code}
> java.lang.NullPointerException: null
> 	at org.apache.hadoop.hdfs.net.DFSTopologyNodeImpl.decStorageTypeCount(DFSTopologyNodeImpl.java:127)
> 	at org.apache.hadoop.hdfs.net.DFSTopologyNodeImpl.remove(DFSTopologyNodeImpl.java:318)
> 	at org.apache.hadoop.hdfs.net.DFSTopologyNodeImpl.remove(DFSTopologyNodeImpl.java:336)
> 	at org.apache.hadoop.net.NetworkTopology.remove(NetworkTopology.java:222)
> 	at org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager.removeDatanode(DatanodeManager.java:712)
> 	at org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager.removeDeadDatanode(DatanodeManager.java:755)
> 	at org.apache.hadoop.hdfs.server.blockmanagement.HeartbeatManager.heartbeatCheck(HeartbeatManager.java:407)
> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManagerTestUtil.noticeDeadDatanode(BlockManagerTestUtil.java:213)
> 	at org.apache.hadoop.hdfs.server.namenode.TestNameNodeProvidedImplementation.testProvidedDatanodeFailures(TestNameNodeProvidedImplementation.java:471)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message