hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vikram Dixit K (JIRA)" <>
Subject [jira] [Updated] (HIVE-3996) Correctly enforce the memory limit on the multi-table map-join
Date Tue, 05 Mar 2013 03:19:12 GMT


Vikram Dixit K updated HIVE-3996:

    Attachment: HIVE-3996_5.patch

Added tests for the sub-query as pointed by Namit. This update should be applied after applying


The commonJoinDispatcher is created new for every query. The only case where we can see an
issue with the global presence of aliasToSize would be if we update a table and then join
in a single query. I am not able to think of any such query. Let me know if there is a way.

I will generate a review request once HIVE-3891 has been committed because currently this
will not apply directly on trunk.

> Correctly enforce the memory limit on the multi-table map-join
> --------------------------------------------------------------
>                 Key: HIVE-3996
>                 URL:
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>    Affects Versions: 0.11.0
>            Reporter: Vikram Dixit K
>            Assignee: Vikram Dixit K
>         Attachments: HIVE-3996_2.patch, HIVE-3996_3.patch, HIVE-3996_4.patch, HIVE-3996_5.patch,
> Currently with HIVE-3784, the joins are converted to map-joins based on checks of the
table size against the config variable: 
> However, the current implementation will also merge multiple mapjoin operators into a
single task regardless of whether the sum of the table sizes will exceed the configured value.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message