hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Peter Vary (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-17346) TestMiniSparkOnYarnCliDriver[spark_dynamic_partition_pruning] is failing every time
Date Thu, 17 Aug 2017 14:16:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Peter Vary updated HIVE-17346:
------------------------------
    Status: Patch Available  (was: Open)

> TestMiniSparkOnYarnCliDriver[spark_dynamic_partition_pruning] is failing every time
> -----------------------------------------------------------------------------------
>
>                 Key: HIVE-17346
>                 URL: https://issues.apache.org/jira/browse/HIVE-17346
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Test
>            Reporter: Peter Vary
>            Assignee: Peter Vary
>         Attachments: HIVE-17346.patch
>
>
> The TestMiniSparkOnYarnCliDriver.testCliDriver - spark_dynamic_partition_pruning is failing
with this diff:
> {code}
> Client Execution succeeded but contained differences (error code = 1) after executing
spark_dynamic_partition_pruning.q 
> 714c714
> <                   filterExpr: ((date = '2008-04-08') and abs(((- UDFToLong(concat(UDFToString(day(ds)),
'0'))) + 10)) is not null) (type: boolean)
> ---
> >                   filterExpr: ((date = '2008-04-08') and ds is not null) (type:
boolean)
> 717c717
> <                     predicate: ((date = '2008-04-08') and abs(((- UDFToLong(concat(UDFToString(day(ds)),
'0'))) + 10)) is not null) (type: boolean)
> ---
> >                     predicate: ((date = '2008-04-08') and ds is not null) (type:
boolean)
> 749c749
> <                   filterExpr: abs(((- UDFToLong(concat(UDFToString(day(ds)), '0')))
+ 10)) is not null (type: boolean)
> ---
> >                   filterExpr: ds is not null (type: boolean)
> 751,752c751,753
> <                   Filter Operator
> <                     predicate: abs(((- UDFToLong(concat(UDFToString(day(ds)), '0')))
+ 10)) is not null (type: boolean)
> ---
> >                   Select Operator
> >                     expressions: ds (type: string)
> >                     outputColumnNames: _col0
> 754,756c755,758
> <                     Select Operator
> <                       expressions: ds (type: string)
> <                       outputColumnNames: _col0
> ---
> >                     Reduce Output Operator
> >                       key expressions: abs(((- UDFToLong(concat(UDFToString(day(_col0)),
'0'))) + 10)) (type: bigint)
> >                       sort order: +
> >                       Map-reduce partition columns: abs(((- UDFToLong(concat(UDFToString(day(_col0)),
'0'))) + 10)) (type: bigint)
> 758,762d759
> <                       Reduce Output Operator
> <                         key expressions: abs(((- UDFToLong(concat(UDFToString(day(_col0)),
'0'))) + 10)) (type: bigint)
> <                         sort order: +
> <                         Map-reduce partition columns: abs(((- UDFToLong(concat(UDFToString(day(_col0)),
'0'))) + 10)) (type: bigint)
> <                         Statistics: Num rows: 2000 Data size: 21248 Basic stats:
COMPLETE Column stats: NONE
> 767c764
> <          
> Output was too long and had to be truncated...
> {code}
> I think it is caused by:
> HIVE-17148 - Incorrect result for Hive join query with COALESCE in WHERE condition
> [~allgoodok]: Am I right? Is it an intended change and only the golden file regeneration
is needed?
> Thanks,
> Peter



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message