hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harish Butani (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-4358) Check for Map side processing in PTFOp is no longer valid
Date Thu, 25 Apr 2013 01:18:16 GMT

    [ https://issues.apache.org/jira/browse/HIVE-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13641269#comment-13641269
] 

Harish Butani commented on HIVE-4358:
-------------------------------------

[~ashutoshc] can you please review this when you get a chance. 
Should try to get this into 0.11; the ReduceDedup optimization can cause the PTFOp to throw
an error.
                
> Check for Map side processing in PTFOp is no longer valid
> ---------------------------------------------------------
>
>                 Key: HIVE-4358
>                 URL: https://issues.apache.org/jira/browse/HIVE-4358
>             Project: Hive
>          Issue Type: Bug
>          Components: PTF-Windowing
>            Reporter: Harish Butani
>         Attachments: HIVE-4358.D10473.1.patch
>
>
> With the changes for ReduceSinkDedup it is no longer true that a non Map-side PTF Operator
is preceded by an ExtractOp. For e.g. following query can produce the issue:
> {noformat}
> create view IF NOT EXISTS mfgr_price_view as 
> select p_mfgr, p_brand, 
> sum(p_retailprice) as s 
> from part 
> group by p_mfgr, p_brand;
>         
> select p_mfgr, p_brand, s, 
> sum(s) over w1  as s1
> from mfgr_price_view 
> window w1 as (distribute by p_mfgr sort by p_brand rows between 2 preceding and current
row);
> {noformat}
> Fix is to add an explicit flag to PTFDesc

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message