hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-3996) Correctly enforce the memory limit on the multi-table map-join
Date Tue, 16 Apr 2013 17:41:18 GMT

    [ https://issues.apache.org/jira/browse/HIVE-3996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13633058#comment-13633058
] 

Hudson commented on HIVE-3996:
------------------------------

Integrated in Hive-trunk-hadoop2 #162 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/162/])
    HIVE-3996 Correctly enforce the memory limit on the multi-table map-join
(Vikram Dixit via namit) (Revision 1468321)

     Result = FAILURE
namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1468321
Files : 
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/CommonJoinResolver.java
* /hive/trunk/ql/src/test/queries/clientpositive/join32_lessSize.q
* /hive/trunk/ql/src/test/results/clientpositive/join32_lessSize.q.out

                
> Correctly enforce the memory limit on the multi-table map-join
> --------------------------------------------------------------
>
>                 Key: HIVE-3996
>                 URL: https://issues.apache.org/jira/browse/HIVE-3996
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>    Affects Versions: 0.11.0
>            Reporter: Vikram Dixit K
>            Assignee: Vikram Dixit K
>         Attachments: HIVE-3996_2.patch, HIVE-3996_3.patch, HIVE-3996_4.patch, HIVE-3996_5.patch,
HIVE-3996_6.patch, HIVE-3996_7.patch, HIVE-3996_8.patch, HIVE-3996_9.patch, hive.3996.9.patch-nohcat,
HIVE-3996.patch
>
>
> Currently with HIVE-3784, the joins are converted to map-joins based on checks of the
table size against the config variable: hive.auto.convert.join.noconditionaltask.size. 
> However, the current implementation will also merge multiple mapjoin operators into a
single task regardless of whether the sum of the table sizes will exceed the configured value.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message