Return-Path: <issues-return-59192-archive-asf-public=cust-asf.ponee.io@hive.apache.org>
X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io
Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io
Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183])
	by cust-asf2.ponee.io (Postfix) with ESMTP id 4483B200BEC
	for <archive-asf-public-internal@cust-asf2.ponee.io>; Thu, 24 Nov 2016 01:06:00 +0100 (CET)
Received: by cust-asf.ponee.io (Postfix)
	id 430EC160AFD; Thu, 24 Nov 2016 00:06:00 +0000 (UTC)
Delivered-To: archive-asf-public@cust-asf.ponee.io
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by cust-asf.ponee.io (Postfix) with SMTP id 89699160B0A
	for <archive-asf-public@cust-asf.ponee.io>; Thu, 24 Nov 2016 01:05:59 +0100 (CET)
Received: (qmail 53842 invoked by uid 500); 24 Nov 2016 00:05:58 -0000
Mailing-List: contact issues-help@hive.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:issues-help@hive.apache.org>
List-Unsubscribe: <mailto:issues-unsubscribe@hive.apache.org>
List-Post: <mailto:issues@hive.apache.org>
List-Id: <issues.hive.apache.org>
Reply-To: dev@hive.apache.org
Delivered-To: mailing list issues@hive.apache.org
Received: (qmail 53822 invoked by uid 99); 24 Nov 2016 00:05:58 -0000
Received: from arcas.apache.org (HELO arcas) (140.211.11.28)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 24 Nov 2016 00:05:58 +0000
Received: from arcas.apache.org (localhost [127.0.0.1])
	by arcas (Postfix) with ESMTP id 615D42C03E0
	for <issues@hive.apache.org>; Thu, 24 Nov 2016 00:05:58 +0000 (UTC)
Date: Thu, 24 Nov 2016 00:05:58 +0000 (UTC)
From: "slim bouguerra (JIRA)" <jira@apache.org>
To: issues@hive.apache.org
Message-ID: <JIRA.13023042.1479945761000.356273.1479945958395@Atlassian.JIRA>
In-Reply-To: <JIRA.13023042.1479945761000@Atlassian.JIRA>
References: <JIRA.13023042.1479945761000@Atlassian.JIRA> <JIRA.13023042.1479945761010@arcas>
Subject: [jira] [Updated] (HIVE-15277) Teach Hive how to create/delete Druid
 segments
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
archived-at: Thu, 24 Nov 2016 00:06:00 -0000


     [ https://issues.apache.org/jira/browse/HIVE-15277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

slim bouguerra updated HIVE-15277:
----------------------------------
    Attachment: file.patch

> Teach Hive how to create/delete Druid segments 
> -----------------------------------------------
>
>                 Key: HIVE-15277
>                 URL: https://issues.apache.org/jira/browse/HIVE-15277
>             Project: Hive
>          Issue Type: Bug
>          Components: Druid integration
>    Affects Versions: 2.2.0
>            Reporter: slim bouguerra
>            Assignee: slim bouguerra
>         Attachments: file.patch
>
>
> We want to extend the DruidStorageHandler to support CTAS queries.
> In this implementation Hive will generate druid segment files and insert the metadata to signal the handoff to druid.
> The syntax will be as follows:
> CREATE TABLE druid_table_1
> STORED BY 'org.apache.hadoop.hive.druid.DruidStorageHandler'
> TBLPROPERTIES ("druid.datasource" = "datasourcename")
> AS <select `timecolumn` as `___time`, `dimension1`,`dimension2`,  `metric1`, `metric2`....>;
> This statement stores the results of query <input_query> in a Druid datasource named 'datasourcename'. One of the columns of the query needs to be the time dimension, which is mandatory in Druid. In particular, we use the same convention that it is used for Druid: there needs to be a the column named '__time' in the result of the executed query, which will act as the time dimension column in Druid. Currently, the time column dimension needs to be a 'timestamp' type column.
> metrics can be of type long, double and float while dimensions are strings. Keep in mind that druid has a clear separation between dimensions and metrics, therefore if you have a column in hive that contains number and need to be presented as dimension use the cast operator to cast as string. 
> This initial implementation interacts with Druid Meta data storage to add/remove the table in druid, user need to supply the meta data config as --hiveconf hive.druid.metadata.password=XXX --hiveconf hive.druid.metadata.username=druid --hiveconf hive.druid.metadata.uri=jdbc:mysql://host/druid



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)