hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Namit Jain (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-1510) HiveCombineInputFormat should not use prefix matching to find the partitionDesc for a given path
Date Wed, 04 Aug 2010 19:05:16 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12895370#action_12895370

Namit Jain commented on HIVE-1510:

Some minor comments

1. Use a different PartitionDesc every time instead of partDesc_1 for the partitions.
2. Spelling mistakes: forth group

Otherwise, it looks good to me. Ning, can you also OK it , since we spent a lot of time debugging
in the past.

Also, before checking it, can you try the following 4 types of queries (with CombineHiveInputFormat):

1. hadoop 17 normal query
2. hadoop 17 sampling query
3. hadoop 20 normal query
4. hadoop 20 sampling query

> HiveCombineInputFormat should not use prefix matching to find the partitionDesc for a
given path
> ------------------------------------------------------------------------------------------------
>                 Key: HIVE-1510
>                 URL: https://issues.apache.org/jira/browse/HIVE-1510
>             Project: Hadoop Hive
>          Issue Type: Bug
>            Reporter: He Yongqiang
>            Assignee: He Yongqiang
>         Attachments: hive-1510.1.patch
> set hive.input.format=org.apache.hadoop.hive.ql.io.CombineHiveInputFormat;
> drop table combine_3_srcpart_seq_rc;
> create table combine_3_srcpart_seq_rc (key int , value string) partitioned by (ds string,
hr string) stored as sequencefile;
> insert overwrite table combine_3_srcpart_seq_rc partition (ds="2010-08-03", hr="00")
select * from src;
> alter table combine_3_srcpart_seq_rc set fileformat rcfile;
> insert overwrite table combine_3_srcpart_seq_rc partition (ds="2010-08-03", hr="001")
select * from src;
> desc extended combine_3_srcpart_seq_rc partition(ds="2010-08-03", hr="00");
> desc extended combine_3_srcpart_seq_rc partition(ds="2010-08-03", hr="001");
> select * from combine_3_srcpart_seq_rc where ds="2010-08-03" order by key;
> drop table combine_3_srcpart_seq_rc;
> will fail.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message