hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jakob Homan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-3585) Integrate Trevni as another columnar oriented file format
Date Tue, 08 Jan 2013 20:40:13 GMT

    [ https://issues.apache.org/jira/browse/HIVE-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13547233#comment-13547233
] 

Jakob Homan commented on HIVE-3585:
-----------------------------------

Expanding on what Sean said.  Yes, there will be a TrevniSerde that doesn't write Avro but
happens to require the Avro libraries.  And there will be an extension to the AvroSerde that
writes Trevni-encoded Avro.  

This patch is going to share 90% of its small code with the existing AvroSerde that was never
shunted into contrib.  Why should this variation be?  There are active users and developers
of this code.  Again, I'm not seeing any technical reasons to block progress.  Is anyone planning
on exercising a -1?
                
> Integrate Trevni as another columnar oriented file format
> ---------------------------------------------------------
>
>                 Key: HIVE-3585
>                 URL: https://issues.apache.org/jira/browse/HIVE-3585
>             Project: Hive
>          Issue Type: Improvement
>          Components: Serializers/Deserializers
>    Affects Versions: 0.10.0
>            Reporter: alex gemini
>            Assignee: Mark Wagner
>            Priority: Minor
>
> add new avro module trevni as another columnar format.New columnar format need a columnar
SerDe,seems fastutil is a good choice.the shark project use fastutil library as columnar serde
library but it seems too large (almost 15m) for just a few primitive array collection.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message