hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jing Zhao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-10180) Getting some error while increasing the hadoop cluster size.
Date Mon, 23 Dec 2013 18:34:50 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-10180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13855827#comment-13855827
] 

Jing Zhao commented on HADOOP-10180:
------------------------------------

Hi Ravi, so which version of hadoop are you using? When you added new disks to DNs, I guess
you also restarted NN right? Then you may also want to check the NN log to see if a block
with Block ID blk_-8997395530627676954_276834 has already been successfully created before
you restarted NN. If yes, HDFS-5590 may be related.

> Getting some error while increasing the hadoop cluster size. 
> -------------------------------------------------------------
>
>                 Key: HADOOP-10180
>                 URL: https://issues.apache.org/jira/browse/HADOOP-10180
>             Project: Hadoop Common
>          Issue Type: Task
>            Reporter: Ravi Hemnani
>            Priority: Trivial
>
> We have a 5-node hadoop cluster and we are trying to increase the size of the cluster.
We have added 2 new disks to each of the 5-boxes and we followed all the steps of putting
the disk to the hadoop cluster. Everything works fine except when we restart a datanode, there
are errors multiple times in the log file. Following is the error which appears in the log
files, 
> 2013-12-23 14:32:19,406 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(172.16.200.128:50010,
storageID=DS-1937554000-172.16.200.128-50010-1376068931321, infoPort=50075, ipcPort=50020):DataXceiver
> org.apache.hadoop.hdfs.server.datanode.BlockAlreadyExistsException: Block blk_-8997395530627676954_276834
is valid, and cannot be written to.
> 	at org.apache.hadoop.hdfs.server.datanode.FSDataset.writeToBlock(FSDataset.java:1428)
> 	at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.<init>(BlockReceiver.java:114)
> 	at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:302)
> 	at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:112)
> 	at java.lang.Thread.run(Thread.java:724)



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message