spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Liang-Chi Hsieh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-21726) Check for structural integrity of the plan in QO in test mode
Date Tue, 15 Aug 2017 14:11:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-21726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16127288#comment-16127288
] 

Liang-Chi Hsieh commented on SPARK-21726:
-----------------------------------------

[~rxin] Thanks for pinging me! Yes, I'm interested in doing this.

> Check for structural integrity of the plan in QO in test mode
> -------------------------------------------------------------
>
>                 Key: SPARK-21726
>                 URL: https://issues.apache.org/jira/browse/SPARK-21726
>             Project: Spark
>          Issue Type: New Feature
>          Components: SQL
>    Affects Versions: 2.2.0
>            Reporter: Reynold Xin
>
> Right now we don't have any checks in the optimizer to check for the structural integrity
of the plan (e.g. resolved). It would be great if in test mode, we can check whether a plan
is still resolved after the execution of each rule, so we can catch rules that return invalid
plans.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message