hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Erik Krogen (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode
Date Thu, 06 Oct 2016 17:50:22 GMT

    [ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15552636#comment-15552636
] 

Erik Krogen edited comment on HDFS-10921 at 10/6/16 5:50 PM:
-------------------------------------------------------------

[~shahrs87], I tried that previously, but when running the entire Test file in one run with
that modification, the first two tests would pass and subsequent ones would fail... I was
thinking it may have something to do with calling {{setImageLoaded}} causing some sort of
inconsistent state in the Namesystem? The error I get is:
{code}
java.lang.IllegalStateException: Cannot skip to less than the current value (=1073741826),
where newValue=1073741825
	at org.apache.hadoop.util.SequentialNumber.skipTo(SequentialNumber.java:58)
	at org.apache.hadoop.hdfs.server.blockmanagement.BlockIdManager.setLastAllocatedContiguousBlockId(BlockIdManager.java:112)
	at org.apache.hadoop.hdfs.server.namenode.FSEditLogLoader.applyEditLogOp(FSEditLogLoader.java:806)
	at org.apache.hadoop.hdfs.server.namenode.FSEditLogLoader.loadEditRecords(FSEditLogLoader.java:240)
	at org.apache.hadoop.hdfs.server.namenode.FSEditLogLoader.loadFSEdits(FSEditLogLoader.java:149)
	at org.apache.hadoop.hdfs.server.namenode.FSImage.loadEdits(FSImage.java:838)
	at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:695)
	at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:291)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:1012)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:666)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:650)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:712)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:928)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:907)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1624)
	at org.apache.hadoop.hdfs.MiniDFSCluster.restartNameNode(MiniDFSCluster.java:2073)
	at org.apache.hadoop.hdfs.MiniDFSCluster.restartNameNodes(MiniDFSCluster.java:2028)
	at org.apache.hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate.testTruncateOverQuota(TestDiskspaceQuotaUpdate.java:347)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
{code}
So it seems to me that it creates an inconsistency between the edit log and the image?


was (Author: xkrogen):
[~shahrs87], I tried that previously, but when running the entire Test file in one run with
that modification, the first two tests would pass and subsequent ones would fail... I was
thinking it may have something to do with calling {{setImageLoaded}} causing some sort of
inconsistent state in the Namesystem?

> TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode
> --------------------------------------------------------------------
>
>                 Key: HDFS-10921
>                 URL: https://issues.apache.org/jira/browse/HDFS-10921
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Eric Badger
>            Assignee: Eric Badger
>         Attachments: HDFS-10921.001.patch, HDFS-10921.002.patch
>
>
> Test fails intermittently because the NN is still in safe mode. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message