hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-12473) DPP: UDFs on the partition column side does not evaluate correctly
Date Tue, 24 Nov 2015 19:34:11 GMT

    [ https://issues.apache.org/jira/browse/HIVE-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025170#comment-15025170
] 

Sergey Shelukhin commented on HIVE-12473:
-----------------------------------------

[~gopalv] can you take a look? I think looking for the column should actually be ok since
the expression is not expected to have any other columns, they would not be able to evaluate
because the row only has one value there. We could even just look for ExprCol... in theory.

> DPP: UDFs on the partition column side does not evaluate correctly
> ------------------------------------------------------------------
>
>                 Key: HIVE-12473
>                 URL: https://issues.apache.org/jira/browse/HIVE-12473
>             Project: Hive
>          Issue Type: Bug
>          Components: Tez
>    Affects Versions: 1.3.0, 1.2.1, 2.0.0
>            Reporter: Gopal V
>            Assignee: Sergey Shelukhin
>         Attachments: HIVE-12473.patch
>
>
> Related to HIVE-12462
> {code}
> select count(1) from accounts a, transactions t where year(a.dt) = year(t.dt) and account_id
= 22;
> $hdt$_0:$hdt$_1:a
>   TableScan (TS_2)
>     alias: a
>     filterExpr: (((account_id = 22) and year(dt) is not null) and (year(dt)) IN (RS[6]))
(type: boolean)
> {code}
> Ends up being evaluated as {{year(cast(dt as int))}} because the pruner only checks for
final type, not the column type.
> {code}
>     ObjectInspector oi =
>         PrimitiveObjectInspectorFactory.getPrimitiveWritableObjectInspector(TypeInfoFactory
>             .getPrimitiveTypeInfo(si.fieldInspector.getTypeName()));
>     Converter converter =
>         ObjectInspectorConverters.getConverter(
>             PrimitiveObjectInspectorFactory.javaStringObjectInspector, oi);
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message