hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-2466) mapjoin_subquery dump small table (mapjoin table) to the same file
Date Tue, 08 Nov 2011 11:40:51 GMT

    [ https://issues.apache.org/jira/browse/HIVE-2466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13146227#comment-13146227
] 

Hudson commented on HIVE-2466:
------------------------------

Integrated in Hive-trunk-h0.21 #1067 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1067/])
    HIVE-2466 mapjoin_subquery dump small table (mapjoin table) to the same file
(binlijin via namit)

namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1199117
Files : 
* /hive/trunk/data/files/x.txt
* /hive/trunk/data/files/y.txt
* /hive/trunk/data/files/z.txt
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/HashTableSinkOperator.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MapJoinOperator.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MapredLocalTask.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/MapJoinProcessor.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/GenMRSkewJoinProcessor.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/HashTableSinkDesc.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/MapJoinDesc.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PlanUtils.java
* /hive/trunk/ql/src/test/queries/clientpositive/mapjoin_subquery2.q
* /hive/trunk/ql/src/test/results/clientpositive/mapjoin_subquery2.q.out

                
> mapjoin_subquery  dump small table (mapjoin table) to the same file
> -------------------------------------------------------------------
>
>                 Key: HIVE-2466
>                 URL: https://issues.apache.org/jira/browse/HIVE-2466
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Processor
>    Affects Versions: 0.7.1
>            Reporter: binlijin
>            Assignee: binlijin
>            Priority: Critical
>         Attachments: D285.1.patch, D285.2.patch, hive-2466.1.patch, hive-2466.2.patch,
hive-2466.3.patch, hive-2466.4.patch
>
>
> in mapjoin_subquery.q  there is a query´╝Ü
> SELECT /*+ MAPJOIN(z) */ subq.key1, z.value
> FROM
> (SELECT /*+ MAPJOIN(x) */ x.key as key1, x.value as value1, y.key as key2, y.value as
value2 
>  FROM src1 x JOIN src y ON (x.key = y.key)) subq
>  JOIN srcpart z ON (subq.key1 = z.key and z.ds='2008-04-08' and z.hr=11);
> when dump x and z to a local file,there all dump to the same file, so we lost the data
of x

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

Mime
View raw message