hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yoram Arnon (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-680) checksum errors reading map output
Date Fri, 03 Nov 2006 19:28:24 GMT
checksum errors reading map output
----------------------------------

                 Key: HADOOP-680
                 URL: http://issues.apache.org/jira/browse/HADOOP-680
             Project: Hadoop
          Issue Type: Bug
          Components: mapred
            Reporter: Yoram Arnon
         Assigned To: Owen O'Malley


we get many exceptions complaining about crc errors reading map output by reducers:

org.apache.hadoop.fs.ChecksumException: Checksum error: /hadoop/mapred/local/task_0189_r_000448_3/map_9683.out
at 978944
	at org.apache.hadoop.fs.FSDataInputStream$Checker.verifySum(FSDataInputStream.java:136)
	at org.apache.hadoop.fs.FSDataInputStream$Checker.read(FSDataInputStream.java:112)
	at org.apache.hadoop.fs.FSDataInputStream$PositionCache.read(FSDataInputStream.java:187)
	at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
	at java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
	at java.io.BufferedInputStream.read(BufferedInputStream.java:313)
	at java.io.DataInputStream.readFully(DataInputStream.java:176)
	at java.io.DataInputStream.readFully(DataInputStream.java:152)
	at org.apache.hadoop.io.SequenceFile$UncompressedBytes.reset(SequenceFile.java:274)
	at org.apache.hadoop.io.SequenceFile$UncompressedBytes.access$700(SequenceFile.java:261)
	at org.apache.hadoop.io.SequenceFile$Reader.nextRaw(SequenceFile.java:1338)
	at org.apache.hadoop.io.SequenceFile$Sorter$SortPass.run(SequenceFile.java:1600)
	at org.apache.hadoop.io.SequenceFile$Sorter.sortPass(SequenceFile.java:1538)
	at org.apache.hadoop.io.SequenceFile$Sorter.sort(SequenceFile.java:1511)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:245)
	at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1210)

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message