avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AVRO-1522) SortedKeyValueFile Writer should support compression codecs
Date Fri, 06 Jun 2014 21:15:02 GMT

    [ https://issues.apache.org/jira/browse/AVRO-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14020389#comment-14020389

ASF subversion and git services commented on AVRO-1522:

Commit 1601014 from [~cutting] in branch 'avro/trunk'
[ https://svn.apache.org/r1601014 ]

AVRO-1522. Java: Add support for compression codecs to SortedKeyValueFile.  Contributed by
Steven Willis.

> SortedKeyValueFile Writer should support compression codecs
> -----------------------------------------------------------
>                 Key: AVRO-1522
>                 URL: https://issues.apache.org/jira/browse/AVRO-1522
>             Project: Avro
>          Issue Type: Bug
>          Components: java
>    Affects Versions: 1.7.6
>            Reporter: Steven Willis
>             Fix For: 1.7.7
>         Attachments: AVRO-1522.patch
> There's no option to set the compression codec on a {{SortedKeyValueFile.Writer}}. And
since the {{Writer}} creates the output file in the constructor and it provides no public
access to the underlying {{DataFileWriter}} anyway, the user can't set a codec themselves.
> I have a patch that will add this functionality through the {{SortedKeyValueFile.Writer.Options}}
class. But we might want to consider if it also makes sense to delay creating the data and
index {{DataFileWriters}} until a {{create()}} method is called, and allow public access to
these writers so a consumer of the API can modify settings of the underlying writers themselves.

This message was sent by Atlassian JIRA

View raw message