avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steven Willis (JIRA)" <j...@apache.org>
Subject [jira] [Created] (AVRO-1522) SortedKeyValueFile Writer should support compression codecs
Date Fri, 30 May 2014 21:38:01 GMT
Steven Willis created AVRO-1522:

             Summary: SortedKeyValueFile Writer should support compression codecs
                 Key: AVRO-1522
                 URL: https://issues.apache.org/jira/browse/AVRO-1522
             Project: Avro
          Issue Type: Bug
    Affects Versions: 1.7.6
            Reporter: Steven Willis

There's no option to set the compression codec on a {{SortedKeyValueFile.Writer}}. And since
the {{Writer}} creates the output file in the constructor and it provides no public access
to the underlying {{DataFileWriter}} anyway, the user can't set a codec themselves.

I have a patch that will add this functionality through the {{SortedKeyValueFile.Writer.Options}}
class. But we might want to consider if it also makes sense to delay creating the data and
index {{DataFileWriters}} until a {{create()}} method is called, and allow public access to
these writers so a consumer of the API can modify settings of the underlying writers themselves.

This message was sent by Atlassian JIRA

View raw message