spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Reynold Xin (JIRA)" <>
Subject [jira] [Created] (SPARK-16475) Broadcast Hint for SQL Queries
Date Mon, 11 Jul 2016 00:34:10 GMT
Reynold Xin created SPARK-16475:

             Summary: Broadcast Hint for SQL Queries
                 Key: SPARK-16475
             Project: Spark
          Issue Type: Improvement
            Reporter: Reynold Xin

Broadcast hint is a way for users to manually annotate a query and suggest to the query optimizer
the join method. It is very useful when the query optimizer cannot make optimal decision with
respect to join methods due to conservativeness or the lack of proper statistics.

The DataFrame API has broadcast hint since Spark 1.5. However, we do not have an equivalent
functionality in SQL queries. We propose adding Hive-style broadcast hint to Spark SQL.

For more information, please see the attached document.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message