Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8D705D90A for ; Sat, 5 Jan 2013 00:38:13 +0000 (UTC) Received: (qmail 30700 invoked by uid 500); 5 Jan 2013 00:38:13 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 30644 invoked by uid 500); 5 Jan 2013 00:38:12 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 30591 invoked by uid 500); 5 Jan 2013 00:38:12 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 30559 invoked by uid 99); 5 Jan 2013 00:38:12 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 05 Jan 2013 00:38:12 +0000 Date: Sat, 5 Jan 2013 00:38:12 +0000 (UTC) From: "He Yongqiang (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HIVE-3585) Integrate Trevni as another columnar oriented file format MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13544382#comment-13544382 ] He Yongqiang commented on HIVE-3585: ------------------------------------ So far i am still not convinced to have it as another builtin serde in Hive's core codebase. We initially did put some new serdes in contrib or 3rd party libs, examples include HBaseSerde and Zebra serde. If you can make it work with existing Avro serde, it will also be great. > Integrate Trevni as another columnar oriented file format > --------------------------------------------------------- > > Key: HIVE-3585 > URL: https://issues.apache.org/jira/browse/HIVE-3585 > Project: Hive > Issue Type: Improvement > Components: Serializers/Deserializers > Affects Versions: 0.10.0 > Reporter: alex gemini > Assignee: Mark Wagner > Priority: Minor > > add new avro module trevni as another columnar format.New columnar format need a columnar SerDe,seems fastutil is a good choice.the shark project use fastutil library as columnar serde library but it seems too large (almost 15m) for just a few primitive array collection. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira