hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kihwal Lee (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6696) Name node cannot start if the path of a file under construction contains ".snapshot"
Date Wed, 16 Jul 2014 21:57:06 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064180#comment-14064180
] 

Kihwal Lee commented on HDFS-6696:
----------------------------------

{panel}
java.io.FileNotFoundException: File does not exist: /xxx/yyy/.snapshot/zzz/aaa
        at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:65)
        at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:55)
        at org.apache.hadoop.hdfs.server.namenode.FSImageFormat$Loader.loadFilesUnderConstruction(FSImageFormat.java:937)
        at org.apache.hadoop.hdfs.server.namenode.FSImageFormat$Loader.load(FSImageFormat.java:424)
        at org.apache.hadoop.hdfs.server.namenode.FSImageFormat$LoaderDelegator.load(FSImageFormat.java:230)
        at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:902)
        at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:888)
        at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImageFile(FSImage.java:711)
        at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:649)
        at org.apache.hadoop.hdfs.server.namenode.FSImage.doUpgrade(FSImage.java:359)
        at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:259)
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:894)
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:641)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:526)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:582)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:747)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:731)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1381)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1447)
{panel}

> Name node cannot start if the path of a file under construction contains ".snapshot"
> ------------------------------------------------------------------------------------
>
>                 Key: HDFS-6696
>                 URL: https://issues.apache.org/jira/browse/HDFS-6696
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Kihwal Lee
>            Assignee: Andrew Wang
>            Priority: Blocker
>
> Using {{-renameReserved}} to rename ".snapshot" in a pre-hdfs-snapshot feature fsimage
during upgrade only works, if there is nothing under construction under the renamed directory.
 I am not sure whether it takes care of edits containing ".snapshot" properly.
> The workaround is to identify these directories and rename, then do {{saveNamespace}}
before performing upgrade.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message