hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-4878) With Dynamic partitioning, some queries would scan default partition even if query is not using it.
Date Thu, 25 Jul 2013 06:19:49 GMT

    [ https://issues.apache.org/jira/browse/HIVE-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13719284#comment-13719284
] 

Hive QA commented on HIVE-4878:
-------------------------------



{color:green}Overall{color}: +1 all checks pass

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12594014/HIVE-4878.patch

{color:green}SUCCESS:{color} +1 2652 tests passed

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/175/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/175/console

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.CleanupPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}

This message is automatically generated.
                
> With Dynamic partitioning, some queries would scan default partition even if query is
not using it.
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-4878
>                 URL: https://issues.apache.org/jira/browse/HIVE-4878
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Processor
>    Affects Versions: 0.11.0
>            Reporter: Laljo John Pullokkaran
>            Assignee: Laljo John Pullokkaran
>             Fix For: 0.11.1
>
>         Attachments: HIVE-4878.patch
>
>
> With Dynamic partitioning, Hive would scan default partitions in some cases even if query
excludes it.
> As part of partition pruning, predicate is narrowed down to those pieces that involve
partition columns only. This predicate is then evaluated with partition values to determine,
if scan should include those partitions.
> But in some cases (like when comparing "__HIVE_DEFAULT_PARTITION__" to numeric data types)
expression evaluation would fail and would return NULL instead of true/false. In such cases
the partition is added to unknown partitions which is then subsequently scanned.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message