spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "peter.zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-4217) Result of SparkSQL is incorrect after a table join and group by operation
Date Wed, 05 Nov 2014 01:13:25 GMT

    [ https://issues.apache.org/jira/browse/SPARK-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14197281#comment-14197281
] 

peter.zhang commented on SPARK-4217:
------------------------------------

It's impossible I tested this SQL both in my dev environment (Hive 0.11) and our company's
production environment, the result from hive were same.
Please tell me what's your hive version

> Result of SparkSQL is incorrect after a table join and group by operation
> -------------------------------------------------------------------------
>
>                 Key: SPARK-4217
>                 URL: https://issues.apache.org/jira/browse/SPARK-4217
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 1.1.0
>         Environment: Hadoop 2.2.0
> Spark1.1
>            Reporter: peter.zhang
>            Priority: Critical
>         Attachments: TestScript.sql, saledata.zip
>
>
> I runed a test using same SQL script in SparkSQL, Shark and Hive environment as below
> ---------------------------------------------------------------
> select c.theyear, sum(b.amount)
> from tblstock a
> join tblStockDetail b on a.ordernumber = b.ordernumber
> join tbldate c on a.dateid = c.dateid
> group by c.theyear;
> result of hive/shark:
> theyear	_c1
> 2004	1403018
> 2005	5557850
> 2006	7203061
> 2007	11300432
> 2008	12109328
> 2009	5365447
> 2010	188944
> result of SparkSQL:
> 2010	210924
> 2004	3265696
> 2005	13247234
> 2006	13670416
> 2007	16711974
> 2008	14670698
> 2009	6322137



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message