Return-Path: Delivered-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Received: (qmail 92196 invoked from network); 7 Jul 2010 23:32:48 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 7 Jul 2010 23:32:48 -0000 Received: (qmail 67745 invoked by uid 500); 7 Jul 2010 23:32:48 -0000 Delivered-To: apmail-hadoop-common-issues-archive@hadoop.apache.org Received: (qmail 67677 invoked by uid 500); 7 Jul 2010 23:32:47 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-issues@hadoop.apache.org Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 67669 invoked by uid 99); 7 Jul 2010 23:32:47 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 07 Jul 2010 23:32:47 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 07 Jul 2010 23:32:44 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id o67NOrpO011845 for ; Wed, 7 Jul 2010 23:24:53 GMT Message-ID: <32038927.249911278545093619.JavaMail.jira@thor> Date: Wed, 7 Jul 2010 19:24:53 -0400 (EDT) From: "Chris Douglas (JIRA)" To: common-issues@hadoop.apache.org Subject: [jira] Updated: (HADOOP-6835) Support concatenated gzip and bzip2 files MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-6835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-6835: ---------------------------------- Status: Resolved (was: Patch Available) Hadoop Flags: [Incompatible change, Reviewed] (was: [Incompatible change]) Resolution: Fixed +1 I committed this. Thanks, Greg! > Support concatenated gzip and bzip2 files > ----------------------------------------- > > Key: HADOOP-6835 > URL: https://issues.apache.org/jira/browse/HADOOP-6835 > Project: Hadoop Common > Issue Type: Improvement > Components: io > Affects Versions: 0.20.2 > Reporter: Tom White > Assignee: Greg Roelofs > Fix For: 0.22.0 > > Attachments: grr-hadoop-common.dif.20100614c, grr-hadoop-mapreduce.dif.20100614c, HADOOP-6835.v3.yahoo-0.20.2xx-branch.patch, HADOOP-6835.v4.trunk-hadoop-common.patch, HADOOP-6835.v4.trunk-hadoop-mapreduce.patch, HADOOP-6835.v4.yahoo-0.20.2xx-branch.patch, HADOOP-6835.v5.trunk-hadoop-common.patch, HADOOP-6835.v6.trunk-hadoop-common.patch, HADOOP-6835.v7.trunk-hadoop-common.patch, HADOOP-6835.v8.trunk-hadoop-common.patch, MR-469.v2.yahoo-0.20.2xx-branch.patch > > > When running MapReduce with concatenated gzip files as input only the first part is read, which is confusing, to say the least. Concatenated gzip is described in http://www.gnu.org/software/gzip/manual/gzip.html#Advanced-usage and in http://www.ietf.org/rfc/rfc1952.txt. (See original report at http://www.nabble.com/Problem-with-Hadoop-and-concatenated-gzip-files-to21383097.html) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.