hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Namit Jain (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-347) [hive] lot of mappers due to a user error while specifying the partitioning column
Date Thu, 19 Mar 2009 19:06:50 GMT

    [ https://issues.apache.org/jira/browse/HIVE-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12683570#action_12683570

Namit Jain commented on HIVE-347:

There was a problem with the above patch. TRUE and unknown is unknown, therefore the patch
was breaking for the following case:

select .. from T where partCol = value and col = 1;

col = 1 will be null even for 'value' partition, therefore 'value' partition will also be

The basic problem is that there is a implicit int to string conversion I dont think this can/should
be fixed.
will upload a new patch undoing the patch

> [hive] lot of mappers due to a user error while specifying the partitioning column
> ----------------------------------------------------------------------------------
>                 Key: HIVE-347
>                 URL: https://issues.apache.org/jira/browse/HIVE-347
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>             Fix For: 0.3.0
>         Attachments: hive.347.1.patch, hive.347.2.patch, hive.347.3.patch
> A common scenario when the table is partitioned on 'ds' column which is of type 'string'
of a certain format 'yyyy-mm-dd'
> However, if the user forgets to add quotes while specifying the query:
> select ... from T where ds = 2009-02-02
> 2009-02-02 is a valid integer expression. So, partition pruning makes all partitions
unknown, since 2009-02-02 to double conversion is null.
> If all partitions are unknown, in strict mode, we should thrown an error

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message