Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6EFCB1014E for ; Wed, 26 Mar 2014 11:19:50 +0000 (UTC) Received: (qmail 64911 invoked by uid 500); 26 Mar 2014 11:19:43 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 64661 invoked by uid 500); 26 Mar 2014 11:19:40 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 64642 invoked by uid 99); 26 Mar 2014 11:19:39 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 26 Mar 2014 11:19:39 +0000 Date: Wed, 26 Mar 2014 11:19:39 +0000 (UTC) From: "Hudson (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HDFS-6130) NPE when upgrading namenode from fsimages older than -32 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13947819#comment-13947819 ] Hudson commented on HDFS-6130: ------------------------------ SUCCESS: Integrated in Hadoop-Yarn-trunk #521 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/521/]) HDFS-6130. NPE when upgrading namenode from fsimages older than -32. Contributed by Haohui Mai. (wheat9: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1581713) * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormat.java > NPE when upgrading namenode from fsimages older than -32 > -------------------------------------------------------- > > Key: HDFS-6130 > URL: https://issues.apache.org/jira/browse/HDFS-6130 > Project: Hadoop HDFS > Issue Type: Bug > Components: namenode > Affects Versions: 2.4.0 > Reporter: Fengdong Yu > Assignee: Haohui Mai > Priority: Blocker > Fix For: 2.4.0 > > Attachments: HDFS-6130.000.patch, fsimage.tar.gz > > > I want upgrade an old cluster(0.20.2-cdh3u1) to trunk instance, > I can upgrade successfully if I don't configurage HA, but if HA enabled, > there is NPE when I run ' hdfs namenode -initializeSharedEdits' > {code} > 14/03/20 15:06:41 INFO namenode.FSNamesystem: Retry cache on namenode is enabled > 14/03/20 15:06:41 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis > 14/03/20 15:06:41 INFO util.GSet: Computing capacity for map NameNodeRetryCache > 14/03/20 15:06:41 INFO util.GSet: VM type = 64-bit > 14/03/20 15:06:41 INFO util.GSet: 0.029999999329447746% max memory 896 MB = 275.3 KB > 14/03/20 15:06:41 INFO util.GSet: capacity = 2^15 = 32768 entries > 14/03/20 15:06:41 INFO namenode.AclConfigFlag: ACLs enabled? false > 14/03/20 15:06:41 INFO common.Storage: Lock on /data/hadoop/data1/dfs/name/in_use.lock acquired by nodename 7326@10-150-170-176 > 14/03/20 15:06:42 INFO common.Storage: Lock on /data/hadoop/data2/dfs/name/in_use.lock acquired by nodename 7326@10-150-170-176 > 14/03/20 15:06:42 INFO namenode.FSImage: No edit log streams selected. > 14/03/20 15:06:42 INFO namenode.FSImageFormatPBINode: Loading 1 INodes. > 14/03/20 15:06:42 FATAL namenode.NameNode: Exception in namenode join > java.lang.NullPointerException > at org.apache.hadoop.hdfs.server.namenode.FSDirectory.isReservedName(FSDirectory.java:2984) > at org.apache.hadoop.hdfs.server.namenode.FSImageFormatPBINode$Loader.addToParent(FSImageFormatPBINode.java:205) > at org.apache.hadoop.hdfs.server.namenode.FSImageFormatPBINode$Loader.loadINodeDirectorySection(FSImageFormatPBINode.java:162) > at org.apache.hadoop.hdfs.server.namenode.FSImageFormatProtobuf$Loader.loadInternal(FSImageFormatProtobuf.java:243) > at org.apache.hadoop.hdfs.server.namenode.FSImageFormatProtobuf$Loader.load(FSImageFormatProtobuf.java:168) > at org.apache.hadoop.hdfs.server.namenode.FSImageFormat$LoaderDelegator.load(FSImageFormat.java:120) > at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:895) > at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:881) > at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImageFile(FSImage.java:704) > at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:642) > at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:271) > at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:894) > at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:653) > at org.apache.hadoop.hdfs.server.namenode.NameNode.initializeSharedEdits(NameNode.java:912) > at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1276) > at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1360) > 14/03/20 15:06:42 INFO util.ExitUtil: Exiting with status 1 > 14/03/20 15:06:42 INFO namenode.NameNode: SHUTDOWN_MSG: > /************************************************************ > SHUTDOWN_MSG: Shutting down NameNode at 10-150-170-176/10.150.170.176 > ************************************************************/ > {code} -- This message was sent by Atlassian JIRA (v6.2#6252)