hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasanth Jayachandran (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-20713) Use percentage for join conversion size thresholds
Date Fri, 12 Oct 2018 23:41:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-20713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Prasanth Jayachandran updated HIVE-20713:
-----------------------------------------
    Attachment: HIVE-20713.1.patch

> Use percentage for join conversion size thresholds
> --------------------------------------------------
>
>                 Key: HIVE-20713
>                 URL: https://issues.apache.org/jira/browse/HIVE-20713
>             Project: Hive
>          Issue Type: Improvement
>    Affects Versions: 4.0.0
>            Reporter: Prasanth Jayachandran
>            Assignee: Prasanth Jayachandran
>            Priority: Major
>         Attachments: HIVE-20713.1.patch
>
>
> There are many places in join conversion that rely on absolute byte sizes for join conversions
(mapjoin, dynamic hashjoin etc.). When container sizes change, these join conversion thresholds
have to be tuned accordingly according to the new container size. Instead, make the join conversions
byte sizes a percentage/fraction of  container size. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message