spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Takeshi Yamamuro (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-24690) Add a new config to control plan stats computation in LogicalRelation
Date Fri, 29 Jun 2018 06:52:00 GMT
Takeshi Yamamuro created SPARK-24690:
----------------------------------------

             Summary: Add a new config to control plan stats computation in LogicalRelation
                 Key: SPARK-24690
                 URL: https://issues.apache.org/jira/browse/SPARK-24690
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 2.3.1
            Reporter: Takeshi Yamamuro


We cannot currently enable StarSchemaDetection.reorderStarJoins because we need to turn off
CBO to enable it but StarSchemaDetection internally references LogicalPlan.stats.rowCount.
This rowCount is used in LogicalRelation if CBO disabled. 

This ticket is to propose a new separate config so that LogicalRelation can use rowCount to
compute data statistics.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message