Return-Path: X-Original-To: apmail-avro-dev-archive@www.apache.org Delivered-To: apmail-avro-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C08A010DB8 for ; Fri, 8 Nov 2013 22:10:17 +0000 (UTC) Received: (qmail 42965 invoked by uid 500); 8 Nov 2013 22:10:17 -0000 Delivered-To: apmail-avro-dev-archive@avro.apache.org Received: (qmail 42909 invoked by uid 500); 8 Nov 2013 22:10:17 -0000 Mailing-List: contact dev-help@avro.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@avro.apache.org Delivered-To: mailing list dev@avro.apache.org Received: (qmail 42900 invoked by uid 99); 8 Nov 2013 22:10:17 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 08 Nov 2013 22:10:17 +0000 Date: Fri, 8 Nov 2013 22:10:17 +0000 (UTC) From: "Doug Cutting (JIRA)" To: dev@avro.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (AVRO-1373) Add A XZ Codec MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/AVRO-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated AVRO-1373: ------------------------------- Attachment: AVRO-1373.patch This looks great. Trunk has drifted a bit since this was first submitted. Here's a version that applies cleanly against current trunk. This fails tests with: testRecodec(org.apache.avro.tool.TestRecodecTool): expected:<4835> but was:<290479> If we can fix this then I'm up for committing this. > Add A XZ Codec > -------------- > > Key: AVRO-1373 > URL: https://issues.apache.org/jira/browse/AVRO-1373 > Project: Avro > Issue Type: New Feature > Components: java > Affects Versions: 1.7.5 > Reporter: Nick White > Assignee: Nick White > Labels: patch > Fix For: 1.7.6 > > Attachments: AVRO-1373.patch, xz-codec.patch > > > The java Avro projects already depend on the commons-library; the attached patch adds support for the XZ codec using classes from it. I've also refactored some of the duplicated code in the tools project (the code that deals with the --codec and --level options) by moving a single copy to the Util class, and calling that from the various tools that produce Avro files. > The XZ codec by default uses the LZMA2 algorithm to compress files - this produces noticeably smaller files than the current bzip2 or deflate codecs. -- This message was sent by Atlassian JIRA (v6.1#6144)