Mailing-List: contact dev-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
Date: Thu, 26 Jul 2012 01:38:34 +0000 (UTC)
From: "Carl Steinbach (JIRA)" <jira@apache.org>
To: hive-dev@hadoop.apache.org
Message-ID: <222441901.104339.1343266714630.JavaMail.jiratomcat@issues-vm>
In-Reply-To: <768970229.90207.1343030554705.JavaMail.jiratomcat@issues-vm>
Subject: [jira] [Commented] (HIVE-3289) sort merge join may not work
 silently
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HIVE-3289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13422819#comment-13422819 ] 

Carl Steinbach commented on HIVE-3289:
--------------------------------------

Two more points which are tangentially related:

* The patch is not attached to this ticket, and it looks like Phabricator stopped automatically attaching patches some time ago. Is anyone at Facebook looking into fixing this?
* Part of the agreement when we started using Phabricator was that the tool would automatically copy review comments back to JIRA. This feature hasn't worked in months, and unless it starts working soon I think we should stop using Phabricator and switch back to ReviewBoard. Is anyone looking into fixing this? If not we should probably just switch back now.
                
> sort merge join may not work silently
> -------------------------------------
>
>                 Key: HIVE-3289
>                 URL: https://issues.apache.org/jira/browse/HIVE-3289
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>
> The user does not know, if the sort-merge join is working or not.
> create table table_asc(key int, value string) CLUSTERED BY (key) SORTED BY (key asc) 
> INTO 1 BUCKETS STORED AS RCFILE; 
> create table table_desc(key int, value string) CLUSTERED BY (key) SORTED BY (key desc) 
> INTO 1 BUCKETS STORED AS RCFILE; 
> set hive.enforce.sorting = true;
> insert overwrite table table_asc select key, value from src;    
> insert overwrite table table_desc select key, value from src;
> set hive.optimize.bucketmapjoin = true;
> set hive.optimize.bucketmapjoin.sortedmerge = true;
> set hive.input.format = org.apache.hadoop.hive.ql.io.BucketizedHiveInputFormat;
> explain 
> select /*+mapjoin(a)*/ * from table_asc a join table_desc b on a.key = b.key;
> select /*+mapjoin(a)*/ * from table_asc a join table_desc b on a.key = b.key;
> explain
> select /*+mapjoin(b)*/ * from table_asc a join table_desc b on a.key = b.key;
> select /*+mapjoin(b)*/ * from table_asc a join table_desc b on a.key = b.key;
> In the above test, the sort-merge join is not obeyed as expected.
> If you user explicitly asked for sort-merge join, and it is not being
> obeyed, the operation should fail.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira