hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harish Butani (JIRA)" <>
Subject [jira] [Commented] (HIVE-4358) Check for Map side processing in PTFOp is no longer valid
Date Thu, 25 Apr 2013 01:18:16 GMT


Harish Butani commented on HIVE-4358:

[~ashutoshc] can you please review this when you get a chance. 
Should try to get this into 0.11; the ReduceDedup optimization can cause the PTFOp to throw
an error.
> Check for Map side processing in PTFOp is no longer valid
> ---------------------------------------------------------
>                 Key: HIVE-4358
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>          Components: PTF-Windowing
>            Reporter: Harish Butani
>         Attachments: HIVE-4358.D10473.1.patch
> With the changes for ReduceSinkDedup it is no longer true that a non Map-side PTF Operator
is preceded by an ExtractOp. For e.g. following query can produce the issue:
> {noformat}
> create view IF NOT EXISTS mfgr_price_view as 
> select p_mfgr, p_brand, 
> sum(p_retailprice) as s 
> from part 
> group by p_mfgr, p_brand;
> select p_mfgr, p_brand, s, 
> sum(s) over w1  as s1
> from mfgr_price_view 
> window w1 as (distribute by p_mfgr sort by p_brand rows between 2 preceding and current
> {noformat}
> Fix is to add an explicit flag to PTFDesc

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message