Mailing-List: contact dev-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
Date: Thu, 17 Feb 2011 06:39:24 +0000 (UTC)
From: "Ted Xu (JIRA)" <jira@apache.org>
To: hive-dev@hadoop.apache.org
Message-ID: 
 <747137030.1954.1297924764380.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] Created: (HIVE-1997) Map join followed by multi-table insert
 will generate duplicated result
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

Map join followed by multi-table insert will generate duplicated result
-----------------------------------------------------------------------

                 Key: HIVE-1997
                 URL: https://issues.apache.org/jira/browse/HIVE-1997
             Project: Hive
          Issue Type: Bug
            Reporter: Ted Xu
             Fix For: 0.7.0


Map join followed by multi-table insert will generate duplicated result, if the insert targets contain both direct insert (FileSinkOperator logic) and group by/distribute by (ReduceSinkOperator logic).

The following query regenerate the case:
{code}
FROM
(SELECT /*+ MAPJOIN(x) */ x.key as key1, x.value as value1, y.key as key2, y.value as value2
 FROM src1 x JOIN src y ON (x.key = y.key)) subq
INSERT OVERWRITE TABLE destpart PARTITION (ds='2010-12-12')
SELECT key1, value1
INSERT OVERWRITE TABLE destpart PARTITION (ds='2010-12-13')
SELECT key2, value2
GROUP BY key2, value2;
{code}
In that query above, records of table destpart(ds='2010-12-12') is duplicated.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira