hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-4241) optimize hive.enforce.sorting and hive.enforce bucketing join
Date Fri, 12 Apr 2013 07:51:16 GMT

    [ https://issues.apache.org/jira/browse/HIVE-4241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13629900#comment-13629900
] 

Hudson commented on HIVE-4241:
------------------------------

Integrated in Hive-trunk-hadoop2 #153 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/153/])
    HIVE-4241 optimize hive.enforce.sorting and hive.enforce bucketing join
(Namit Jain via Gang Tim Liu) (Revision 1467174)

     Result = FAILURE
namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1467174
Files : 
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/TableScanOperator.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/BucketingSortingReduceSinkOptimizer.java
* /hive/trunk/ql/src/test/queries/clientpositive/bucketsortoptimize_insert_1.q
* /hive/trunk/ql/src/test/queries/clientpositive/bucketsortoptimize_insert_2.q
* /hive/trunk/ql/src/test/queries/clientpositive/bucketsortoptimize_insert_3.q
* /hive/trunk/ql/src/test/queries/clientpositive/bucketsortoptimize_insert_4.q
* /hive/trunk/ql/src/test/queries/clientpositive/bucketsortoptimize_insert_5.q
* /hive/trunk/ql/src/test/queries/clientpositive/bucketsortoptimize_insert_6.q
* /hive/trunk/ql/src/test/queries/clientpositive/bucketsortoptimize_insert_7.q
* /hive/trunk/ql/src/test/queries/clientpositive/bucketsortoptimize_insert_8.q
* /hive/trunk/ql/src/test/results/clientpositive/bucketsortoptimize_insert_1.q.out
* /hive/trunk/ql/src/test/results/clientpositive/bucketsortoptimize_insert_2.q.out
* /hive/trunk/ql/src/test/results/clientpositive/bucketsortoptimize_insert_3.q.out
* /hive/trunk/ql/src/test/results/clientpositive/bucketsortoptimize_insert_4.q.out
* /hive/trunk/ql/src/test/results/clientpositive/bucketsortoptimize_insert_5.q.out
* /hive/trunk/ql/src/test/results/clientpositive/bucketsortoptimize_insert_6.q.out
* /hive/trunk/ql/src/test/results/clientpositive/bucketsortoptimize_insert_7.q.out
* /hive/trunk/ql/src/test/results/clientpositive/bucketsortoptimize_insert_8.q.out

                
> optimize hive.enforce.sorting and hive.enforce bucketing join
> -------------------------------------------------------------
>
>                 Key: HIVE-4241
>                 URL: https://issues.apache.org/jira/browse/HIVE-4241
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>             Fix For: 0.11.0
>
>         Attachments: hive.4241.1.patch, hive.4241.1.patch-nohcat, hive.4241.2.patch-nohcat,
hive.4241.3.patch, hive.4241.4.patch
>
>
> Consider the following scenario:
> T1: sorted and bucketed by key into 2 buckets
> T2: sorted and bucketed by key into 2 buckets
> T3: sorted and bucketed by key into 2 buckets
> set hive.enforce.sorting=true;
> set hive.enforce.bucketing=true;
> insert overwrite table T3
> select .. from T1 join T2 on T1.key = T2.key;
> Since T1, T2 and T3 are sorted/bucketed by the join, and the above join is
> being performed as a sort-merge join, T3 should be bucketed/sorted without
> the need for an extra reducer.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message