spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sathiya Kumar (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-22080) Allow developers to add pre-optimisation rules
Date Wed, 20 Sep 2017 15:08:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-22080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16173313#comment-16173313
] 

Sathiya Kumar commented on SPARK-22080:
---------------------------------------

Here is a PR with the proposed changes: https://github.com/apache/spark/pull/19295

> Allow developers to add pre-optimisation rules
> ----------------------------------------------
>
>                 Key: SPARK-22080
>                 URL: https://issues.apache.org/jira/browse/SPARK-22080
>             Project: Spark
>          Issue Type: New Feature
>          Components: SQL
>    Affects Versions: 2.1.1, 2.2.0
>            Reporter: Sathiya Kumar
>            Priority: Minor
>
> [SPARK-9843] added support for adding custom rules for optimising LogicalPlan, but the
added rules are only applied only after all the spark's native rules are applied. Allowing
users to plug in pre-optimisation rules facilitate some advanced optimisation.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message