hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Uma Maheswara Rao G <mahesw...@huawei.com>
Subject RE: could not sink exception
Date Thu, 22 Dec 2011 06:36:22 GMT
At what load you are running the cluster?

Looks NN not able to choose the targets for block.

When choosing the targets NN will check many conditions like what is the thread count in DNs
and allocated space for the node, ...etc.

If NN finds any of the nodes in that situation it will not choose the targets. That logs were
debug logs. If you are getting this error frequently, you can just enable the debug log and
check the reason once.



From: Jayaseelan E [jayaseelan.e@ericsson.com]
Sent: Thursday, December 22, 2011 11:58 AM
To: Harsh J; hdfs-user@hadoop.apache.org
Subject: REG:could not sink exception

When we tried to run the hadoop flows we got the following exception for all the tasks and
it is failed.error is little bit confusing.I have two data nodes,but both are healthy and
nodes are
Up and running.
com.ericsson.cim.base.core.exception.CimProcessingException: Could not sink. Got an IOException
with message: org.apache.hadoop.ipc.RemoteException: java.io.IOException: File /data/processing/events/usage/Processed_at_20111215100837/_temporary/_attempt_201112150454_0036_m_000000_0/ServiceUsageChargedAccBalCS4_20111001-m-00000
could only be replicated to 0 nodes, instead of 1
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1282)
at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:469)
at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:512)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:968)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:964)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:962)

Thanks indeed

View raw message