From hadoop-dev-return-4795-apmail-lucene-hadoop-dev-archive=lucene.apache.org@lucene.apache.org Fri Nov 03 19:28:49 2006 Return-Path: Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org Received: (qmail 17050 invoked from network); 3 Nov 2006 19:28:46 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 3 Nov 2006 19:28:46 -0000 Received: (qmail 56003 invoked by uid 500); 3 Nov 2006 19:28:56 -0000 Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org Received: (qmail 55979 invoked by uid 500); 3 Nov 2006 19:28:56 -0000 Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-dev@lucene.apache.org Received: (qmail 55963 invoked by uid 99); 3 Nov 2006 19:28:56 -0000 Received: from herse.apache.org (HELO herse.apache.org) (140.211.11.133) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Nov 2006 11:28:56 -0800 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests= X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO brutus.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Nov 2006 11:28:44 -0800 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 3950B714314 for ; Fri, 3 Nov 2006 11:28:24 -0800 (PST) Message-ID: <17159689.1162582104231.JavaMail.root@brutus> Date: Fri, 3 Nov 2006 11:28:24 -0800 (PST) From: "Yoram Arnon (JIRA)" To: hadoop-dev@lucene.apache.org Subject: [jira] Created: (HADOOP-680) checksum errors reading map output MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org checksum errors reading map output ---------------------------------- Key: HADOOP-680 URL: http://issues.apache.org/jira/browse/HADOOP-680 Project: Hadoop Issue Type: Bug Components: mapred Reporter: Yoram Arnon Assigned To: Owen O'Malley we get many exceptions complaining about crc errors reading map output by reducers: org.apache.hadoop.fs.ChecksumException: Checksum error: /hadoop/mapred/local/task_0189_r_000448_3/map_9683.out at 978944 at org.apache.hadoop.fs.FSDataInputStream$Checker.verifySum(FSDataInputStream.java:136) at org.apache.hadoop.fs.FSDataInputStream$Checker.read(FSDataInputStream.java:112) at org.apache.hadoop.fs.FSDataInputStream$PositionCache.read(FSDataInputStream.java:187) at java.io.BufferedInputStream.fill(BufferedInputStream.java:218) at java.io.BufferedInputStream.read1(BufferedInputStream.java:256) at java.io.BufferedInputStream.read(BufferedInputStream.java:313) at java.io.DataInputStream.readFully(DataInputStream.java:176) at java.io.DataInputStream.readFully(DataInputStream.java:152) at org.apache.hadoop.io.SequenceFile$UncompressedBytes.reset(SequenceFile.java:274) at org.apache.hadoop.io.SequenceFile$UncompressedBytes.access$700(SequenceFile.java:261) at org.apache.hadoop.io.SequenceFile$Reader.nextRaw(SequenceFile.java:1338) at org.apache.hadoop.io.SequenceFile$Sorter$SortPass.run(SequenceFile.java:1600) at org.apache.hadoop.io.SequenceFile$Sorter.sortPass(SequenceFile.java:1538) at org.apache.hadoop.io.SequenceFile$Sorter.sort(SequenceFile.java:1511) at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:245) at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1210) -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira