hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From cho ju il <tjst...@kgrid.co.kr>
Subject How do you find the source of the load?
Date Tue, 25 Nov 2014 01:43:37 GMT
 
I can not find the cause of rising load data nodes. 
How do you find the source of the load? 
 
 
 
**** datanode log
 
2014-11-25 06:07:35,432 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Block blk_5029028296867344001_7218414
unfinalized and removed.
2014-11-25 06:07:35,432 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration
(192.168.10.47:90010, storageID=, infoPort=90075, ipcPort=90020):DataXceiver
java.io.EOFException: while trying to read 65536 bytes
        at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.readToBuf(BlockReceiver.java:295)
        at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.readNextPacket(BlockReceiver.java:382)
        at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:403)
        at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:581)
        at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:406)
        at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:112)
        at java.lang.Thread.run(Thread.java:662)
Mime
View raw message