hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Furkan Bıçak <bicak...@gmail.com>
Subject Re: Secondary NameNode doCheckpoint Exception
Date Thu, 03 Oct 2013 10:18:37 GMT
Yes, I am doing some development and starting my hadoop cluster using my 
IDE.

Thanks,
Frkn.
On 03-10-2013 13:06, Jitendra Yadav wrote:
> When you said "started from java" does that means you are doing some 
> development work using eclipse and hadoop?
>
> May be I'm not familiar with this kind of environment.
>
> Regards
> Jitendra
>
>
> On Thu, Oct 3, 2013 at 3:24 PM, Furkan Bıçak <bicak.cs@gmail.com 
> <mailto:bicak.cs@gmail.com>> wrote:
>
>     I don't have any problem when starting and stoping the cluster
>     with scripts. I am having this problem when starting the cluster
>     from Java.
>
>     Also, when I start the cluster from Java, I can run map-reduce
>     jobs and it succesfully finishes. However, after some time about 5
>     minutes when the secondary namenode is started, it tries the merge
>     and then gives that error.
>
>     Thanks,
>     Frkn.
>
>     On 03-10-2013 12:10, Jitendra Yadav wrote:
>>     Can you restart your cluster using below scripts and check the logs?
>>
>>     # stop-all.sh
>>     #start-all.sh
>>
>>     Regards
>>     Jitendra
>>
>>
>>     On Thu, Oct 3, 2013 at 2:09 PM, Furkan Bıçak <bicak.cs@gmail.com
>>     <mailto:bicak.cs@gmail.com>> wrote:
>>
>>         No, I started from scratch.
>>
>>         Thanks,
>>         Frkn.
>>
>>
>>         On 03-10-2013 11:32, Jitendra Yadav wrote:
>>>         Did you upgraded your cluster ?
>>>
>>>         Regards
>>>         Jitendra
>>>
>>>
>>>         On Thu, Oct 3, 2013 at 1:22 PM, Furkan Bıçak
>>>         <bicak.cs@gmail.com <mailto:bicak.cs@gmail.com>> wrote:
>>>
>>>             On 03-10-2013 10:44, Furkan Bıçak wrote:
>>>
>>>                 Hi Everyone,
>>>
>>>                 I am starting my hadoop cluster manually from Java
>>>                 which works fine until some time. When secondary
>>>                 NameNode tries to do merge it gives me the following
>>>                 exception:
>>>
>>>                 ---------------------------
>>>                 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>>                 Throwable Exception in doCheckpoint:
>>>                 13/10/03 10:29:38 ERROR namenode.SecondaryNameNode:
>>>                 java.lang.AssertionError: Negative layout version is
>>>                 expected.
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>                     at java.lang.Thread.run(Thread.java:724)
>>>
>>>                 java.lang.AssertionError: Negative layout version is
>>>                 expected.
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:857)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:780)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$600(SecondaryNameNode.java:680)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:557)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:521)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:396)
>>>                     at
>>>                 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:360)
>>>                     at java.lang.Thread.run(Thread.java:724)
>>>                 ---------------------------
>>>
>>>                 What causes this exception to occur?
>>>                 Any help would be appreciated!
>>>
>>>                 Kind Regards,
>>>
>>>                 Furkan Bicak.
>>>
>>>             I forgot to mention the hadoop version. I am using
>>>             hadoop 1.2.1 version.
>>>
>>>             Thanks.
>>>
>>>
>>
>>
>
>


Mime
View raw message