hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "dhruba borthakur (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-3520) Generation stamp upgrade fails TestDFSUpgradeFromImage
Date Wed, 18 Jun 2008 02:04:44 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-3520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

dhruba borthakur updated HADOOP-3520:
-------------------------------------

    Attachment: upgradeNPE.patch

I agree with Konstantin's analysis. The only possibility is that there is a race between initializeUpgrade
and startUpgrade. I am uploading a patch that fixes this problem.

I have run the unit test about 50 times, but have never been able to reproduce this problem
anyway. 

> Generation stamp upgrade fails TestDFSUpgradeFromImage
> ------------------------------------------------------
>
>                 Key: HADOOP-3520
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3520
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.18.0
>            Reporter: Konstantin Shvachko
>            Assignee: Konstantin Shvachko
>            Priority: Blocker
>             Fix For: 0.18.0
>
>         Attachments: failure.log, upgradeNPE.patch
>
>
> TestDFSUpgradeFromImage occasionally fails doing distributed upgrade related to generation
stamps with the following NPE:
> {code}
> java.lang.NullPointerException
> 	at org.apache.hadoop.dfs.UpgradeManagerDatanode.initializeUpgrade(UpgradeManagerDatanode.java:54)
> 	at org.apache.hadoop.dfs.DataStorage.verifyDistributedUpgradeProgress(DataStorage.java:402)
> 	at org.apache.hadoop.dfs.DataStorage.doTransition(DataStorage.java:232)
> 	at org.apache.hadoop.dfs.DataStorage.recoverTransitionRead(DataStorage.java:139)
> 	at org.apache.hadoop.dfs.DataNode.startDataNode(DataNode.java:268)
> 	at org.apache.hadoop.dfs.DataNode.<init>(DataNode.java:185)
> 	at org.apache.hadoop.dfs.DataNode.makeInstance(DataNode.java:2952)
> 	at org.apache.hadoop.dfs.DataNode.instantiateDataNode(DataNode.java:2907)
> 	at org.apache.hadoop.dfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:401)
> 	at org.apache.hadoop.dfs.MiniDFSCluster.<init>(MiniDFSCluster.java:267)
> 	at org.apache.hadoop.dfs.MiniDFSCluster.<init>(MiniDFSCluster.java:162)
> 	at org.apache.hadoop.dfs.TestDFSUpgradeFromImage.testUpgradeFromImage(TestDFSUpgradeFromImage.java:180)
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message