spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dileep Kumar (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-11873) Regression for TPC-DS query 63 when used with decimal datatype and windows function
Date Tue, 01 Dec 2015 23:45:10 GMT

    [ https://issues.apache.org/jira/browse/SPARK-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034885#comment-15034885
] 

Dileep Kumar commented on SPARK-11873:
--------------------------------------

Did not try on Spark 1.6. Do you think there is a fix for this in 1.6 if so would you please
point to the related JIRA.

> Regression for TPC-DS query 63 when used with decimal datatype and windows function
> -----------------------------------------------------------------------------------
>
>                 Key: SPARK-11873
>                 URL: https://issues.apache.org/jira/browse/SPARK-11873
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 1.5.0
>            Reporter: Dileep Kumar
>              Labels: perfomance
>         Attachments: 63.1.1, 63.1.5, 63.decimal_schema, 63.decimal_schema_windows_function,
63.double_schema, 98.1.1, 98.1.5, decimal_schema.sql, double_schema.sql
>
>
> When running the TPC-DS based queries for benchmarking spark found that query 63 (after
making it similar to original query) show different behavior compared to other queries eg.
q98 which has similar function.
> Here are performance numbers(execution time in seconds):
> 	1.1 Baseline	1.5	1.5 + Decimal
> q63	27	26	38
> q98	18	26	24
> As you can see q63 is showing regression compared to similar query. I am attaching the
both version of queries and affected schemas. When adding the windows function back this is
the only query seem to be slower than 1.1 in 1.5.
> I have attached the both version of schema and queries.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message