hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ning Zhang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-936) dynamic partitions creation based on values
Date Thu, 01 Apr 2010 18:49:27 GMT

    [ https://issues.apache.org/jira/browse/HIVE-936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12852506#action_12852506
] 

Ning Zhang commented on HIVE-936:
---------------------------------

A patch for HIVE-1002 has been upload. That patch deals with insert only. Please take a look
and review. I will upload a patch for CTAS on this JIRA. 

> dynamic partitions creation based on values
> -------------------------------------------
>
>                 Key: HIVE-936
>                 URL: https://issues.apache.org/jira/browse/HIVE-936
>             Project: Hadoop Hive
>          Issue Type: New Feature
>            Reporter: Ning Zhang
>            Assignee: Ning Zhang
>         Attachments: dp_design.txt
>
>
> If a Hive table is created as partitioned, DML could only inserted into one partitioin
per query. Ideally partitions should be created on the fly based on the value of the partition
columns. As an example:
> {{{
>   create table T (a int, b string) partitioned by (ds string);
>   insert overwrite table T select a, b, ds from S where ds >= '2009-11-01' and ds
<= '2009-11-16';
> }}}
> should be able to execute in one DML rather than possibley 16 DML for each distinct ds
values. CTAS and alter table should be able to do the same thing:
> {{{
>   create table T partitioned by (ds string) as select * from S where ds >= '2009-11-01'
and ds <= '2009-11-16';
> }}}
>  and
> {{{
>   create table T(a int, b string, ds string);
>   insert overwrite table T select * from S where ds >= '2009-11-1' and ds <= '2009-11-16';
>   alter table T partitioned by (ds);
> }}}
> should all return the same results.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message