Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 33298200B67 for ; Tue, 16 Aug 2016 21:28:22 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 31ECF160ABE; Tue, 16 Aug 2016 19:28:22 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id A8C2F160AA8 for ; Tue, 16 Aug 2016 21:28:21 +0200 (CEST) Received: (qmail 5459 invoked by uid 500); 16 Aug 2016 19:28:20 -0000 Mailing-List: contact issues-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list issues@hive.apache.org Received: (qmail 5321 invoked by uid 99); 16 Aug 2016 19:28:20 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 16 Aug 2016 19:28:20 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id A9D432C02A8 for ; Tue, 16 Aug 2016 19:28:20 +0000 (UTC) Date: Tue, 16 Aug 2016 19:28:20 +0000 (UTC) From: "Vaibhav Gumashta (JIRA)" To: issues@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Resolved] (HIVE-13595) HiveServer2: Evaluate if ThriftJDBCBinarySerde should implement VectorizedSerde MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 16 Aug 2016 19:28:22 -0000 [ https://issues.apache.org/jira/browse/HIVE-13595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vaibhav Gumashta resolved HIVE-13595. ------------------------------------- Resolution: Later We've investigated the idea of implementing VectorizedSerde interface for writing final results, but as of now there are some issues: 1. Not all datatypes are vectorized. 2. For the ones that are, we'll also need to avoid the vector --> row --> columnar translation we're doing. 3. For final write, we'll need to use VectorFileSinkOperator instead of FileSinkOperator. We'll take up these as separate jiras in HIVE-14549. Thanks [~ziyangz] for the investigation. > HiveServer2: Evaluate if ThriftJDBCBinarySerde should implement VectorizedSerde > ------------------------------------------------------------------------------- > > Key: HIVE-13595 > URL: https://issues.apache.org/jira/browse/HIVE-13595 > Project: Hive > Issue Type: Sub-task > Components: HiveServer2 > Affects Versions: 2.1.0 > Reporter: Vaibhav Gumashta > Assignee: Ziyang Zhao > > As part of HIVE-12049, ThriftJDBCBinarySerde was introduced which buffers rows and writes thrift converted columnar row batches as part of the final task output. Hive has VectorizedSerde which is used during vectorized operations. We should explore if ThriftJDBCBinarySerde should implement that. -- This message was sent by Atlassian JIRA (v6.3.4#6332)