hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arpit Agarwal (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-12985) NameNode crashes during restart after an OpenForWrite file present in the Snapshot got deleted
Date Wed, 14 Feb 2018 19:06:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-12985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364626#comment-16364626
] 

Arpit Agarwal commented on HDFS-12985:
--------------------------------------

Hi [~manojg], I was looking at the test case to understand the problem better. The test passes
for me even without the fix in INodeFile (I ran the new test against git hash 2ee0d64aceed876f57f09eb9efe1872b6de98d2e).

Do you see the test fail without the fix?

> NameNode crashes during restart after an OpenForWrite file present in the Snapshot got
deleted
> ----------------------------------------------------------------------------------------------
>
>                 Key: HDFS-12985
>                 URL: https://issues.apache.org/jira/browse/HDFS-12985
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: hdfs
>    Affects Versions: 2.8.0
>            Reporter: Manoj Govindassamy
>            Assignee: Manoj Govindassamy
>            Priority: Major
>             Fix For: 3.1.0, 2.10.0, 3.0.1
>
>         Attachments: HDFS-12985.01.patch
>
>
> NameNode crashes repeatedly with NPE at the startup when trying to find the total number
of under construction blocks. This crash happens after an open file, which was also part of
a snapshot gets deleted along with the snapshot.
> {noformat}
> Failed to start namenode.
> java.lang.NullPointerException
> 	at org.apache.hadoop.hdfs.server.namenode.LeaseManager.getNumUnderConstructionBlocks(LeaseManager.java:146)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getCompleteBlocksTotal(FSNamesystem.java:6537)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startCommonServices(FSNamesystem.java:1232)
> 	at org.apache.hadoop.hdfs.server.namenode.NameNode.startCommonServices(NameNode.java:706)
> 	at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:692)
> 	at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:844)
> 	at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:823)
> 	at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1547)
> 	at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1615)
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message