hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Artem Ervits" <are9...@nyp.org>
Subject getting warning messages when running M/R
Date Thu, 09 Aug 2012 14:09:46 GMT
Hello all,

This may be unrelated and/or belong to a different mailing list but issue I'm having is evident
only with M/R. I've been playing with Hadoop ports and iptables and after a recent change
I'd noticed the following messages every time I execute a job:

12/08/09 10:02:06 INFO hdfs.DFSClient: Exception in createBlockOutputStream 192.168.1.100:50010
java.io.IOException: Bad connect ack with firstBadLink as 192.168.1.103:50010
12/08/09 10:02:06 INFO hdfs.DFSClient: Abandoning block blk_1399101038038930115_1309
12/08/09 10:02:06 INFO hdfs.DFSClient: Excluding datanode 192.168.1.103:50010
12/08/09 10:02:06 INFO hdfs.DFSClient: Exception in createBlockOutputStream 192.168.1.100:50010
java.io.IOException: Bad connect ack with firstBadLink as 192.168.1.101:50010
12/08/09 10:02:06 INFO hdfs.DFSClient: Abandoning block blk_-8044771541473099539_1309
12/08/09 10:02:06 INFO hdfs.DFSClient: Excluding datanode 192.168.1.101:50010
12/08/09 10:02:06 INFO mapred.FileInputFormat: Total input paths to process : 10
12/08/09 10:02:06 INFO hdfs.DFSClient: Exception in createBlockOutputStream 192.168.1.100:50010
java.io.IOException: Bad connect ack with firstBadLink as 192.168.1.101:50010
12/08/09 10:02:06 INFO hdfs.DFSClient: Abandoning block blk_-7369573366706223799_1310


I searched on the interwebs and found a link to a similar message but that only related to
datanodes not working. All datanodes do indeed work. M/R finishes successfully and I get results
but I don't want to see any extra information if not necessary. Please advise.

Thank you.

Artem Ervits
Data Analyst
New York Presbyterian Hospital


________________________________
This electronic message is intended to be for the use only of the named recipient, and may
contain information that is confidential or privileged. If you are not the intended recipient,
you are hereby notified that any disclosure, copying, distribution or use of the contents
of this message is strictly prohibited. If you have received this message in error or are
not the named recipient, please notify us immediately by contacting the sender at the electronic
mail address noted above, and delete and destroy all copies of this message. Thank you.


--------------------

This electronic message is intended to be for the use only of the named recipient, and may
contain information that is confidential or privileged.  If you are not the intended recipient,
you are hereby notified that any disclosure, copying, distribution or use of the contents
of this message is strictly prohibited.  If you have received this message in error or are
not the named recipient, please notify us immediately by contacting the sender at the electronic
mail address noted above, and delete and destroy all copies of this message.  Thank you.




--------------------

This electronic message is intended to be for the use only of the named recipient, and may
contain information that is confidential or privileged.  If you are not the intended recipient,
you are hereby notified that any disclosure, copying, distribution or use of the contents
of this message is strictly prohibited.  If you have received this message in error or are
not the named recipient, please notify us immediately by contacting the sender at the electronic
mail address noted above, and delete and destroy all copies of this message.  Thank you.




Mime
View raw message