hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zoltan Haindrich (JIRA)" <>
Subject [jira] [Commented] (HIVE-20915) Make dynamic sort partition optimization available to HoS and MR
Date Sat, 08 Dec 2018 06:04:00 GMT


Zoltan Haindrich commented on HIVE-20915:

I believe beyond column stats autogather there might be other features which have be tampered
with - and because the q.out updates seem to be careless.
I think in that case this feature should be disabled globally - because its buggy....and after
all known issues were addressed; enable it - but take special care for every q.out update

Please understand that we just can't let to break existing features...if the development spans
to month or years; those broken features will eventually be released...

> Make dynamic sort partition optimization available to HoS and MR
> ----------------------------------------------------------------
>                 Key: HIVE-20915
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Planning
>    Affects Versions: 4.0.0
>            Reporter: Yongzhi Chen
>            Assignee: Yongzhi Chen
>            Priority: Major
>             Fix For: 4.0.0
>         Attachments: HIVE-20915.1.patch, HIVE-20915.2.patch, HIVE-20915.3.patch, HIVE-20915.4.patch,
> HIVE-20703 put dynamic sort partition optimization under cost based decision, but it
also makes the optimizer only available to tez. hive.optimize.sort.dynamic.partition works
with other execution engines for a long time, we should keep the optimizer available to them.

This message was sent by Atlassian JIRA

View raw message