Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-dev@hadoop.apache.org
Date: Thu, 29 Dec 2011 04:56:30 +0000 (UTC)
From: "Harsh J (Resolved) (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: 
 <1387788896.50495.1325134590878.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Resolved] (HADOOP-2893) checksum exceptions on trunk
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


     [ https://issues.apache.org/jira/browse/HADOOP-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Harsh J resolved HADOOP-2893.
-----------------------------

    Resolution: Cannot Reproduce

This was probably resolved at some point long ago. Gone stale now, and doesn't seem to occur anymore.

Marking resolved as can't reproduce.
                
> checksum exceptions on trunk
> ----------------------------
>
>                 Key: HADOOP-2893
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2893
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 0.15.3, 0.17.0
>            Reporter: Lohit Vijayarenu
>
> While running jobs like Sort/WordCount on trunk I see few task failures with ChecksumException
> Re-running the tasks on different nodes succeeds. 
> Here is the stack
> {noformat}
> Map output lost, rescheduling: getMapOutput(task_200802251721_0004_m_000237_0,29) failed :
> org.apache.hadoop.fs.ChecksumException: Checksum error: /tmps/4/mapred-tt/mapred-local/task_200802251721_0004_m_000237_0/file.out at 2085376
>   at org.apache.hadoop.fs.FSInputChecker.verifySum(FSInputChecker.java:276)
>   at org.apache.hadoop.fs.FSInputChecker.readChecksumChunk(FSInputChecker.java:238)
>   at org.apache.hadoop.fs.FSInputChecker.read1(FSInputChecker.java:189)
>   at org.apache.hadoop.fs.FSInputChecker.read(FSInputChecker.java:157)
>   at java.io.DataInputStream.read(DataInputStream.java:132)
>   at org.apache.hadoop.mapred.TaskTracker$MapOutputServlet.doGet(TaskTracker.java:2299)
>   at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
>   at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>   at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:427)
>   at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationHandler.java:475)
>   at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:567)
>   at org.mortbay.http.HttpContext.handle(HttpContext.java:1565)
>   at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationContext.java:635)
>   at org.mortbay.http.HttpContext.handle(HttpContext.java:1517)
>   at org.mortbay.http.HttpServer.service(HttpServer.java:954)
>   at org.mortbay.http.HttpConnection.service(HttpConnection.java:814)
>   at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:981)
>   at org.mortbay.http.HttpConnection.handle(HttpConnection.java:831)
>   at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:244)
>   at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
>   at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)
> {noformat}
> another stack
> {noformat}
> Caused by: org.apache.hadoop.fs.ChecksumException: Checksum error: /tmps/4/mapred-tt/mapred-local/task_200802251721_0004_r_000110_0/map_367.out at 21884416
>   at org.apache.hadoop.fs.FSInputChecker.verifySum(FSInputChecker.java:276)
>   at org.apache.hadoop.fs.FSInputChecker.readChecksumChunk(FSInputChecker.java:238)
>   at org.apache.hadoop.fs.FSInputChecker.fill(FSInputChecker.java:176)
>   at org.apache.hadoop.fs.FSInputChecker.read1(FSInputChecker.java:193)
>   at org.apache.hadoop.fs.FSInputChecker.read(FSInputChecker.java:157)
>   at java.io.DataInputStream.readFully(DataInputStream.java:178)
>   at org.apache.hadoop.io.DataOutputBuffer$Buffer.write(DataOutputBuffer.java:56)
>   at org.apache.hadoop.io.DataOutputBuffer.write(DataOutputBuffer.java:90)
>   at org.apache.hadoop.io.SequenceFile$Reader.nextRawKey(SequenceFile.java:1930)
>   at org.apache.hadoop.io.SequenceFile$Sorter$SegmentDescriptor.nextRawKey(SequenceFile.java:2958)
>   at org.apache.hadoop.io.SequenceFile$Sorter$MergeQueue.next(SequenceFile.java:2716)
>   at org.apache.hadoop.mapred.ReduceTask$ValuesIterator.getNext(ReduceTask.java:209)
>   at org.apache.hadoop.mapred.ReduceTask$ValuesIterator.next(ReduceTask.java:177)
>   ... 5 more
> {noformat}
> both with local files

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira