hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zoltan Haindrich (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-17934) Merging Statistics are promoted to COMPLETE (most of the time)
Date Tue, 31 Oct 2017 14:20:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-17934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Zoltan Haindrich updated HIVE-17934:
------------------------------------
    Attachment: HIVE-17934.01.patch

#1)

* remove the reactive stat state guessing method
* make the guessing only work when a new object is created
* change the way stat objects are merged

this patch will most probably break almost all qtest outputs....

> Merging Statistics are promoted to COMPLETE (most of the time)
> --------------------------------------------------------------
>
>                 Key: HIVE-17934
>                 URL: https://issues.apache.org/jira/browse/HIVE-17934
>             Project: Hive
>          Issue Type: Bug
>          Components: Statistics
>            Reporter: Zoltan Haindrich
>            Assignee: Zoltan Haindrich
>         Attachments: HIVE-17934.01.patch
>
>
> in case multiple partition statistics are merged the STATS state is computed based on
the datasize and rowcount;
> the merge may hide away non-existent stats in case there are other partition or operators
which do contribute to the datasize and the rowcount.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message