hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "He Yongqiang (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HIVE-3585) Integrate Trevni as another columnar oriented file format
Date Mon, 07 Jan 2013 22:42:16 GMT

    [ https://issues.apache.org/jira/browse/HIVE-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13546348#comment-13546348
] 

He Yongqiang edited comment on HIVE-3585 at 1/7/13 10:40 PM:
-------------------------------------------------------------

contrib is a good place for any projects that is not mature. There are so many custom data
formats out there, it does not make sense to support all of them in core hive code base. contrib
is a good place for them to grow. 

>From http://incubator.apache.org/hcatalog/docs/r0.4.0/, another good place i can think
of is the hcatalog project. But i don't know if hcatalog itself includes custom data format
support or not.
                
      was (Author: he yongqiang):
    contrib is a good place for any projects that is not mature. There are so many custom
data formats out there, it does not make sense to support all of them in core hive code base.
contrib is a good place for them to grow. 

Another good place i can think of is the hcatalog project.  

                  
> Integrate Trevni as another columnar oriented file format
> ---------------------------------------------------------
>
>                 Key: HIVE-3585
>                 URL: https://issues.apache.org/jira/browse/HIVE-3585
>             Project: Hive
>          Issue Type: Improvement
>          Components: Serializers/Deserializers
>    Affects Versions: 0.10.0
>            Reporter: alex gemini
>            Assignee: Mark Wagner
>            Priority: Minor
>
> add new avro module trevni as another columnar format.New columnar format need a columnar
SerDe,seems fastutil is a good choice.the shark project use fastutil library as columnar serde
library but it seems too large (almost 15m) for just a few primitive array collection.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message