hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Koifman (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-8061) improve the speed of col stats update speed
Date Thu, 11 Sep 2014 21:28:33 GMT

    [ https://issues.apache.org/jira/browse/HIVE-8061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14130744#comment-14130744
] 

Eugene Koifman commented on HIVE-8061:
--------------------------------------

there is TestCompactor.java under itests.  This is how I uncovered the issue in the first
place.  You can try running this.

> improve the speed of col stats update speed
> -------------------------------------------
>
>                 Key: HIVE-8061
>                 URL: https://issues.apache.org/jira/browse/HIVE-8061
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Pengcheng Xiong
>            Assignee: Pengcheng Xiong
>            Priority: Minor
>         Attachments: HIVE-8061.1.patch
>
>
> We worked hard towards faster update stats for columns of a partition of a table previously
https://issues.apache.org/jira/browse/HIVE-7736
> and https://issues.apache.org/jira/browse/HIVE-7876
> Although there is some improvement, it is only correct in the first run. There will be
duplicate column stats later. Thanks to Eugene Koifman 's comments.
> We fixed this in https://issues.apache.org/jira/browse/HIVE-7944 by reversing the patch.
> This JIRA ticket is my another try to improve the speed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message