spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Reynold Xin (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-16475) Broadcast Hint for SQL Queries
Date Mon, 11 Jul 2016 00:34:10 GMT
Reynold Xin created SPARK-16475:
-----------------------------------

             Summary: Broadcast Hint for SQL Queries
                 Key: SPARK-16475
                 URL: https://issues.apache.org/jira/browse/SPARK-16475
             Project: Spark
          Issue Type: Improvement
            Reporter: Reynold Xin


Broadcast hint is a way for users to manually annotate a query and suggest to the query optimizer
the join method. It is very useful when the query optimizer cannot make optimal decision with
respect to join methods due to conservativeness or the lack of proper statistics.

The DataFrame API has broadcast hint since Spark 1.5. However, we do not have an equivalent
functionality in SQL queries. We propose adding Hive-style broadcast hint to Spark SQL.

For more information, please see the attached document.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message