hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Namit Jain (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-970) mapjoin should be disabled if the size is too large
Date Thu, 07 Jan 2010 19:24:54 GMT

    [ https://issues.apache.org/jira/browse/HIVE-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797752#action_12797752

Namit Jain commented on HIVE-970:

Yes, you can close this as a duplicate

> mapjoin should be disabled if the size is too large
> ---------------------------------------------------
>                 Key: HIVE-970
>                 URL: https://issues.apache.org/jira/browse/HIVE-970
>             Project: Hadoop Hive
>          Issue Type: New Feature
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Ning Zhang
> Based on a detailed discussion with Ning, we were thinking of the following.
> Add a configurable parameter, which sets the limit on the usage of mapjoin.
> Assume that only the following can increase the size of the table:
> UDTF, Transforms, Union, Join
> (Although UDF and UDAF can also increase the total size by increasing the size of the
row, that is not likely to happen in the common case).
> So, the map join hint will only be honored if none of the above are present at the source
and the size of the table is less than the limit.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message