hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Furkan Bıçak <bicak...@gmail.com>
Subject Re: Secondary NameNode doCheckpoint Exception
Date Thu, 03 Oct 2013 10:25:43 GMT
What I simply do is starting NameNode, DataNode, SecondaryNameNode, 
JobTracker and TaskTracker respectively. Why would SecondaryNameNode 
throws an exception when doing merge. Am I missing some configurations? 
Or how can I set checkpoint period?

Thanks,
Frkn.

On 03-10-2013 13:18, Furkan Bıçak wrote:
> Yes, I am doing some development and starting my hadoop cluster using 
> my IDE.
>
> Thanks,
> Frkn.
> On 03-10-2013 13:06, Jitendra Yadav wrote:
>> When you said "started from java" does that means you are doing some 
>> development work using eclipse and hadoop?
>>
>> May be I'm not familiar with this kind of environment.
>>
>> Regards
>> Jitendra
>>
>>
>> On Thu, Oct 3, 2013 at 3:24 PM, Furkan Bıçak <bicak.cs@gmail.com 
>> <mailto:bicak.cs@gmail.com>> wrote:
>>
>>     I don't have any problem when starting and stoping the cluster
>>     with scripts. I am having this problem when starting the cluster
>>     from Java.
>>
>>     Also, when I start the cluster from Java, I can run map-reduce
>>     jobs and it succesfully finishes. However, after some time about
>>     5 minutes when the secondary namenode is started, it tries the
>>     merge and then gives that error.
>>
>>     Thanks,
>>     Frkn.
>>
>>     On 03-10-2013 12:10, Jitendra Yadav wrote:
>>>     Can you restart your cluster using below scripts and check the
>>>     logs?
>>>
>>>     # stop-all.sh
>>>     #start-all.sh
>>>
>>>     Regards
>>>     Jitendra
>>>
>>>
>>>     On Thu, Oct 3, 2013 at 2:09 PM, Furkan Bıçak <bicak.cs@gmail.com
>>>     <mailto:bicak.cs@gmail.com>> wrote:
>>>
>>>         No, I started from scratch.
>>>
>>>         Thanks,
>>>         Frkn.
>>>
>>>
>>>         On 03-10-2013 11:32, Jitendra Yadav wrote:
>>>>         Did you upgraded your cluster ?
>>>>
>>>>         Regards
>>>>         Jitendra
>>>>
>>>>
>>>>         On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak
>>>>         <bicak.cs@gmail.com <mailto:bicak.cs@gmail.com>> wrote:
>>>>
>>>>             On 03-10-2013 10:44, Furkan Bıçak wrote:
>>>>
>>>>                 Hi Everyone,
>>>>
>>>>                 I am starting my hadoop cluster manually from Java
>>>>                 which works fine until some time. When secondary
>>>>                 NameNode tries to do merge it gives me the
>>>>                 following exception:
>>>>
>>>>                 ---------------------------
>>>>                 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>>>                 Throwable Exception in doCheckpoint:
>>>>                 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>>>                 java.lang.AssertionError: Negative layout version
>>>>                 is expected.
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>>                     at java.lang.Thread.run(Thread.java:724)
>>>>
>>>>                 java.lang.AssertionError: Negative layout version
>>>>                 is expected.
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>>                     at
>>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>>                     at java.lang.Thread.run(Thread.java:724)
>>>>                 ---------------------------
>>>>
>>>>                 What causes this exception to occur?
>>>>                 Any help would be appreciated!
>>>>
>>>>                 Kind Regards,
>>>>
>>>>                 Furkan Bicak.
>>>>
>>>>             I forgot to mention the hadoop version. I am using
>>>>             hadoop 1.2.1 version.
>>>>
>>>>             Thanks.
>>>>
>>>>
>>>
>>>
>>
>>
>


Mime
View raw message