Mailing-List: contact dev-help@avro.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@avro.apache.org
Date: Sat, 1 Sep 2012 06:19:08 +1100 (NCT)
From: "Scott Carey (JIRA)" <jira@apache.org>
To: dev@avro.apache.org
Message-ID: <521683659.24248.1346440748649.JavaMail.jiratomcat@arcas>
In-Reply-To: 
 <745708165.68509.1303255565721.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Commented] (AVRO-806) add a column-major codec for data
 files
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446273#comment-13446273 ] 

Scott Carey commented on AVRO-806:
----------------------------------

I think (1) is the best way to start.  We could easily transition to (2) if that made sense due to other language implementations, and (3) if it grows big enough.

We may want to identify it separately as 'evolving' or similar so that API changes in the next couple releases if needed can be managed more flexibly.
                
> add a column-major codec for data files
> ---------------------------------------
>
>                 Key: AVRO-806
>                 URL: https://issues.apache.org/jira/browse/AVRO-806
>             Project: Avro
>          Issue Type: New Feature
>          Components: java, spec
>            Reporter: Doug Cutting
>            Assignee: Doug Cutting
>         Attachments: AVRO-806.patch, AVRO-806-v2.patch, avro-file-columnar.pdf
>
>
> Define a codec that, when a data file's schema is a record schema, writes blocks within the file in column-major order.  This would permit better compression and also permit efficient skipping of fields that are not of interest.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira