hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yongzhi Chen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-15520) Improve the sum performance for Range based window
Date Wed, 11 Jan 2017 17:51:48 GMT

    [ https://issues.apache.org/jira/browse/HIVE-15520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15818957#comment-15818957
] 

Yongzhi Chen commented on HIVE-15520:
-------------------------------------

[~aihuaxu], have compared the performance improvement for the common use case?
And how do you handle the case which may not satisfy the equation: new_sum = sum + [p2, p2']
- [p1, p1']. ?

Fox example: Sum (1/Avg(val))


> Improve the sum performance for Range based window
> --------------------------------------------------
>
>                 Key: HIVE-15520
>                 URL: https://issues.apache.org/jira/browse/HIVE-15520
>             Project: Hive
>          Issue Type: Sub-task
>          Components: PTF-Windowing
>            Reporter: Aihua Xu
>            Assignee: Aihua Xu
>         Attachments: HIVE-15520.1.patch, HIVE-15520.2.patch, HIVE-15520.3.patch, HIVE-15520.4.patch
>
>
> Currently streaming process is not supported for range based windowing. Thus sum( x )
over (partition by y order by z) is O(n^2) running time. 
> Investigate the possibility of streaming support.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message