hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zoltan Haindrich (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-20915) Make dynamic sort partition optimization available to HoS and MR
Date Sat, 08 Dec 2018 06:04:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-20915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16713558#comment-16713558
] 

Zoltan Haindrich commented on HIVE-20915:
-----------------------------------------

I believe beyond column stats autogather there might be other features which have be tampered
with - and because the q.out updates seem to be careless.
I think in that case this feature should be disabled globally - because its buggy....and after
all known issues were addressed; enable it - but take special care for every q.out update

Please understand that we just can't let to break existing features...if the development spans
to month or years; those broken features will eventually be released...

> Make dynamic sort partition optimization available to HoS and MR
> ----------------------------------------------------------------
>
>                 Key: HIVE-20915
>                 URL: https://issues.apache.org/jira/browse/HIVE-20915
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Planning
>    Affects Versions: 4.0.0
>            Reporter: Yongzhi Chen
>            Assignee: Yongzhi Chen
>            Priority: Major
>             Fix For: 4.0.0
>
>         Attachments: HIVE-20915.1.patch, HIVE-20915.2.patch, HIVE-20915.3.patch, HIVE-20915.4.patch,
HIVE-20915.5.patch
>
>
> HIVE-20703 put dynamic sort partition optimization under cost based decision, but it
also makes the optimizer only available to tez. hive.optimize.sort.dynamic.partition works
with other execution engines for a long time, we should keep the optimizer available to them.




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message