Return-Path: Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: (qmail 83741 invoked from network); 11 Feb 2010 17:27:13 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 11 Feb 2010 17:27:13 -0000 Received: (qmail 55934 invoked by uid 500); 11 Feb 2010 17:27:11 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 55866 invoked by uid 500); 11 Feb 2010 17:27:11 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 55856 invoked by uid 99); 11 Feb 2010 17:27:11 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 11 Feb 2010 17:27:11 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of yuzhihong@gmail.com designates 209.85.210.193 as permitted sender) Received: from [209.85.210.193] (HELO mail-yx0-f193.google.com) (209.85.210.193) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 11 Feb 2010 17:27:04 +0000 Received: by yxe31 with SMTP id 31so1360901yxe.21 for ; Thu, 11 Feb 2010 09:26:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:date:message-id:subject :from:to:content-type; bh=g7XLJH4lwoLtB8Lbrd47eSpqmymyOedOwdND1KjQTy0=; b=MhtZQ3LiBZRSFwrPogyVdSBP+2yJJc50pf/DCcOa65V5TAz95U+6vC9OMuQnGX7Niq YBIaZoWypcvautZInd4liiAyIER/5hKKBMtLBO+7ZnVDGFinHLhlaiTR/0CYkghN7VVJ 2Xlv6Th8M3MBxul3q37wdkUsD3eB1IiiH3BE4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; b=K1+5sJbs3t7RGV6/0SAHD6SUN2wXsD13wEPZX3Wd03+nXgcV2PhAPbLbodg8Nuirt3 I4hjM7LLZ4p/mVle77XmfNhNQtvzQ/ZQ2j3VZe05CrZBzLpOxoRyBMAmrkP4MMQmHJic XcTmL/ieKZDIS3TwpG2pBLgImLsS16pbpHriY= MIME-Version: 1.0 Received: by 10.142.5.22 with SMTP id 22mr124248wfe.14.1265909203216; Thu, 11 Feb 2010 09:26:43 -0800 (PST) Date: Thu, 11 Feb 2010 09:26:43 -0800 Message-ID: <17e273101002110926u2fdfa8bcp494bad992ae09abf@mail.gmail.com> Subject: ChecksumException From: Ted Yu To: common-user@hadoop.apache.org Content-Type: multipart/alternative; boundary=00504502ae75602ab3047f56740b --00504502ae75602ab3047f56740b Content-Type: text/plain; charset=ISO-8859-1 Hi, I see the following in our log: org.apache.hadoop.fs.ChecksumException: Checksum error: file:/domain_crawler/crawlworker/crawl/777_pv_10_4_20100128_122735_353.done.tsk/segments/20100131163704/parse_data/part-00000/data at 42990592 at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.readChunk(ChecksumFileSystem.java:211) at org.apache.hadoop.fs.FSInputChecker.readChecksumChunk(FSInputChecker.java:238) at org.apache.hadoop.fs.FSInputChecker.fill(FSInputChecker.java:177) at org.apache.hadoop.fs.FSInputChecker.read1(FSInputChecker.java:194) at org.apache.hadoop.fs.FSInputChecker.read(FSInputChecker.java:159) at java.io.DataInputStream.readFully(DataInputStream.java:178) at org.apache.hadoop.io.DataOutputBuffer$Buffer.write(DataOutputBuffer.java:64) at org.apache.hadoop.io.DataOutputBuffer.write(DataOutputBuffer.java:102) at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1933) at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1833) at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1879) at com.rialto.webmap.common.SeqFileWriter.writeSeqFile(SeqFileWriter.java:189) HFWriter uses Hadoop version 0.18.3 Please share your experience solving this error. Thanks --00504502ae75602ab3047f56740b--