hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tomas Hudik (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-12063) tar.gz compression doesn't produce correct output
Date Thu, 04 Jun 2015 18:06:38 GMT
Tomas Hudik created HADOOP-12063:

             Summary: tar.gz compression doesn't produce correct output
                 Key: HADOOP-12063
                 URL: https://issues.apache.org/jira/browse/HADOOP-12063
             Project: Hadoop Common
          Issue Type: Bug
    Affects Versions: 2.4.0
            Reporter: Tomas Hudik

I'm not completely sure whether this is the right place to put this issue since Pig is involved,
however, Pig leave decompression of tar.gz to   hadoop-common.

How to reproduce the issue: 

# simple file (file1) with arbitrary text lines put into in1 in HDFS
# same file (file1) compressed by tar -cvzf file1.tar.gz file put into in2 in HDFS
# issue simple pig commands in pig:
raw = load 'in1/' USING TextLoader AS (line: bytearray);
dump raw;
run for both (compressed and uncompressed file)
# in case of compressed version you will get strange 1st line
a0000644000570000001440000000002512534073736011260 0ustar loadhadoopusersa

This message was sent by Atlassian JIRA

View raw message