hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Greg Roelofs (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-1927) unit test for HADOOP-6835 (concatenated gzip support)
Date Fri, 13 Aug 2010 04:55:16 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-1927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Greg Roelofs updated MAPREDUCE-1927:
------------------------------------

    Attachment: construct-all-gz-header-types-20100812.zip

Script and gzip component subfiles to generate all 32 unencrypted flagbits variants (that
is, text/binary, comment/no comment, header CRC/no header CRC, etc.).

These are not currently used by the unit test, but they could be.  Is it worth it?

(Note that gzip versions up through 1.4 cannot be used to test the 16 header-CRC variants.
 A fix was checked into gzip's trunk on 20100703, however:  http://git.savannah.gnu.org/cgit/gzip.git/commit/?id=97e225c0e8ee24f3fc9ff7c5cec63e74aefbb6a0
.  zlib-based gzip decoders [zlib >= 1.2.1.2] can read all 32 variants successfully.)


> unit test for HADOOP-6835 (concatenated gzip support)
> -----------------------------------------------------
>
>                 Key: MAPREDUCE-1927
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1927
>             Project: Hadoop Map/Reduce
>          Issue Type: Test
>          Components: test
>    Affects Versions: 0.22.0
>            Reporter: Greg Roelofs
>            Assignee: Greg Roelofs
>            Priority: Minor
>             Fix For: 0.22.0
>
>         Attachments: construct-all-gz-header-types-20100812.zip, MR-1927.v9.trunk-hadoop-mapreduce.patch
>
>
> More extensive test of concatenated gzip (and bzip2) decoding support for HADOOP-6835
(and HADOOP-4012 and HADOOP-6852).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message