hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nitin Pawar <nitinpawar...@gmail.com>
Subject Re: why hadoop-daemon.sh stop itself
Date Wed, 02 Jul 2014 08:57:43 GMT
see this error
ava.io.IOException: Incompatible clusterIDs in /home/yarn/hadoop-2.2.0/hdfs/dn:
namenode clusterID = CID-c91ccd10-8ea0-4fb3-9037-d5f57694674e; datanode
clusterID = CID-89e2e0b8-2d61-4d6a-9424-ab46e4f83cab

Did you format your namenode ? after formatting the namenode did you delete
the contents for datanode directory?


On Wed, Jul 2, 2014 at 2:24 PM, EdwardKing <zhangsc@neusoft.com> wrote:

>  I find logs,but I don't know how to do it. Thanks
>
> 2014-07-02 01:07:38,473 FATAL
> org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for
> block pool Block pool BP-279671289-127.0.0.1-1404285849267 (storage id
> DS-601761441-127.0.0.1-50010-1404205370190) service to localhost/
> 127.0.0.1:9000
> java.io.IOException: Incompatible clusterIDs in
> /home/yarn/hadoop-2.2.0/hdfs/dn: namenode clusterID =
> CID-c91ccd10-8ea0-4fb3-9037-d5f57694674e; datanode clusterID =
> CID-89e2e0b8-2d61-4d6a-9424-ab46e4f83cab
>  at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:391)
>  at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:191)
>  at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:219)
>  at
> org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:837)
>  at
> org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:808)
>  at
> org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:280)
>  at
> org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:222)
>  at
> org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:664)
>  at java.lang.Thread.run(Thread.java:745)
> 2014-07-02 01:07:38,489 WARN
> org.apache.hadoop.hdfs.server.datanode.DataNode: Ending block pool service
> for: Block pool BP-279671289-127.0.0.1-1404285849267 (storage id
> DS-601761441-127.0.0.1-50010-1404205370190) service to localhost/
> 127.0.0.1:9000
> 2014-07-02 01:07:38,601 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: Removed Block pool
> BP-279671289-127.0.0.1-1404285849267 (storage id
> DS-601761441-127.0.0.1-50010-1404205370190)
> 2014-07-02 01:07:40,602 WARN
> org.apache.hadoop.hdfs.server.datanode.DataNode: Exiting Datanode
> 2014-07-02 01:07:40,606 INFO org.apache.hadoop.util.ExitUtil: Exiting with
> status 0
> 2014-07-02 01:07:40,610 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down DataNode at localhost.localdomain/127.0.0.1
> ************************************************************/
> 2014-07-02 01:08:34,956 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
> /************************************************************
>
>
>
> ----- Original Message -----
> *From:* Nitin Pawar <nitinpawar432@gmail.com>
> *To:* user@hadoop.apache.org
> *Sent:* Wednesday, July 02, 2014 4:49 PM
> *Subject:* Re: why hadoop-daemon.sh stop itself
>
> pull out the logs from datanode log file
>
> it will tell why it stopped
>
>
> On Wed, Jul 2, 2014 at 2:05 PM, EdwardKing <zhangsc@neusoft.com> wrote:
>
>>  I use hadoop2.2.0 , I start hadoop-daemon service,like follows:
>>
>>  [hdfs@localhost logs]$ hadoop-daemon.sh start namenode
>> [hdfs@localhost logs]$ hadoop-daemon.sh start secondarynamenode
>> [hdfs@localhost logs]$ hadoop-daemon.sh start datanode
>> [hdfs@localhost logs]$ jps
>> 4135 NameNode
>> 4270 SecondaryNameNode
>> 4331 DataNode
>> 4364 Jps
>>
>> After a while,when I use jps command,I find datanode is disappeared.Why?
>>  [hdfs@localhost logs]$ jps
>> 4135 NameNode
>> 4270 SecondaryNameNode
>> 4364 Jps
>>
>>
>>
>> ---------------------------------------------------------------------------------------------------
>> Confidentiality Notice: The information contained in this e-mail and any
>> accompanying attachment(s)
>> is intended only for the use of the intended recipient and may be
>> confidential and/or privileged of
>> Neusoft Corporation, its subsidiaries and/or its affiliates. If any
>> reader of this communication is
>> not the intended recipient, unauthorized use, forwarding, printing,
>> storing, disclosure or copying
>> is strictly prohibited, and may be unlawful.If you have received this
>> communication in error,please
>> immediately notify the sender by return e-mail, and delete the original
>> message and all copies from
>> your system. Thank you.
>>
>> ---------------------------------------------------------------------------------------------------
>>
>
>
>
> --
> Nitin Pawar
>
>
> ---------------------------------------------------------------------------------------------------
> Confidentiality Notice: The information contained in this e-mail and any
> accompanying attachment(s)
> is intended only for the use of the intended recipient and may be
> confidential and/or privileged of
> Neusoft Corporation, its subsidiaries and/or its affiliates. If any reader
> of this communication is
> not the intended recipient, unauthorized use, forwarding, printing,
> storing, disclosure or copying
> is strictly prohibited, and may be unlawful.If you have received this
> communication in error,please
> immediately notify the sender by return e-mail, and delete the original
> message and all copies from
> your system. Thank you.
>
> ---------------------------------------------------------------------------------------------------
>



-- 
Nitin Pawar

Mime
View raw message