Return-Path: X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2808195BE for ; Mon, 8 Oct 2012 22:10:06 +0000 (UTC) Received: (qmail 85806 invoked by uid 500); 8 Oct 2012 22:10:03 -0000 Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org Received: (qmail 85609 invoked by uid 500); 8 Oct 2012 22:10:03 -0000 Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-dev@hadoop.apache.org Delivered-To: mailing list common-dev@hadoop.apache.org Received: (qmail 85565 invoked by uid 99); 8 Oct 2012 22:10:02 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 08 Oct 2012 22:10:02 +0000 Date: Mon, 8 Oct 2012 22:10:02 +0000 (UTC) From: "Slavik Krassovsky (JIRA)" To: common-dev@hadoop.apache.org Message-ID: <2014658438.11203.1349734202889.JavaMail.jiratomcat@arcas> Subject: [jira] [Created] (HADOOP-8900) BuiltInGzipDecompressor : java.io.IOException: stored gzip size doesn't match decompressed size (Slavik Krassovsky) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 Slavik Krassovsky created HADOOP-8900: ----------------------------------------- Summary: BuiltInGzipDecompressor : java.io.IOException: stored= gzip size doesn't match decompressed size (Slavik Krassovsky) Key: HADOOP-8900 URL: https://issues.apache.org/jira/browse/HADOOP-8900 Project: Hadoop Common Issue Type: Bug Environment: Encountered failure when processing large GZIP file Reporter: Slavik Krassovsky Encountered failure when processing large GZIP file =E2=80=A2 Gz: Failed in 1hrs, 13mins, 57sec with the error: =C2=B8java.io.IOException: IO error in map input file hdfs://localhost:900= 0/Halo4/json_m/gz/NewFileCat.txt.gz at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.moveToNext(MapTask= .java:242) at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:= 216) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:48) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:435) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:371) at org.apache.hadoop.mapred.Child$4.run(Child.java:266) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformati= on.java:1059) at org.apache.hadoop.mapred.Child.main(Child.java:260) Caused by: java.io.IOException: stored gzip size doesn't match decompresse= d size at org.apache.hadoop.io.compress.zlib.BuiltInGzipDecompressor.executeTrail= erState(BuiltInGzipDecompressor.java:389) at org.apache.hadoop.io.compress.zlib.BuiltInGzipDecompressor.decompress(B= uiltInGzipDecompressor.java:224) at org.apache.hadoop.io.compress.DecompressorStream.decompress(Decompresso= rStream.java:82) at org.apache.hadoop.io.compress.DecompressorStream.read(DecompressorStrea= m.java:76) at java.io.InputStream.read(InputStream.java:102) at org.apache.hadoop.util.LineReader.readLine(LineReader.java:134) at org.apache.hadoop.mapred.LineRecordReader.next(LineRecordReader.java:13= 6) at org.apache.hadoop.mapred.LineRecordReader.next(LineRecordReader.java:40= ) at org.apache.hadoop.hive.ql.io.HiveRecordReader.doNext(HiveRecordReader.j= ava:66) at org.apache.hadoop.hive.ql.io.HiveRecordReader.doNext(HiveRecordReader.j= ava:32) at org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.next(HiveCont= extAwareRecordReader.java:67) at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.moveToNext(MapTask= .java:236) ... 9 more -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrato= rs For more information on JIRA, see: http://www.atlassian.com/software/jira