avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Cutting (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AVRO-1373) Add A XZ Codec
Date Fri, 08 Nov 2013 22:10:17 GMT

     [ https://issues.apache.org/jira/browse/AVRO-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Doug Cutting updated AVRO-1373:

    Attachment: AVRO-1373.patch

This looks great.  Trunk has drifted a bit since this was first submitted.

Here's a version that applies cleanly against current trunk.

This fails tests with:
 testRecodec(org.apache.avro.tool.TestRecodecTool): expected:<4835> but was:<290479>

If we can fix this then I'm up for committing this.

> Add A XZ Codec
> --------------
>                 Key: AVRO-1373
>                 URL: https://issues.apache.org/jira/browse/AVRO-1373
>             Project: Avro
>          Issue Type: New Feature
>          Components: java
>    Affects Versions: 1.7.5
>            Reporter: Nick White
>            Assignee: Nick White
>              Labels: patch
>             Fix For: 1.7.6
>         Attachments: AVRO-1373.patch, xz-codec.patch
> The java Avro projects already depend on the commons-library; the attached patch adds
support for the XZ codec using classes from it. I've also refactored some of the duplicated
code in the tools project (the code that deals with the --codec and --level options) by moving
a single copy to the Util class, and calling that from the various tools that produce Avro
> The XZ codec by default uses the LZMA2 algorithm to compress files - this produces noticeably
smaller files than the current bzip2 or deflate codecs.

This message was sent by Atlassian JIRA

View raw message