spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Maciej Bryński (JIRA) <j...@apache.org>
Subject [jira] [Commented] (SPARK-10577) [PySpark, SQL] DataFrame hint for broadcast join
Date Sat, 12 Sep 2015 12:46:45 GMT

    [ https://issues.apache.org/jira/browse/SPARK-10577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742042#comment-14742042
] 

Maciej Bryński commented on SPARK-10577:
----------------------------------------

Same without Hive support.
Py4JJavaError: An error occurred while calling o30.sql.
{code}
: java.lang.RuntimeException: [1.42] failure: ``union'' expected but `(' found
select * from t1 join broadcast(t2) on t1.k1 = t2.k2
                                                ^
	at scala.sys.package$.error(package.scala:27)
	at org.apache.spark.sql.catalyst.AbstractSparkSQLParser.parse(AbstractSparkSQLParser.scala:36)
	at org.apache.spark.sql.catalyst.DefaultParserDialect.parse(ParserDialect.scala:67)
	at org.apache.spark.sql.SQLContext$$anonfun$3.apply(SQLContext.scala:169)
	at org.apache.spark.sql.SQLContext$$anonfun$3.apply(SQLContext.scala:169)

{code}

> [PySpark, SQL] DataFrame hint for broadcast join
> ------------------------------------------------
>
>                 Key: SPARK-10577
>                 URL: https://issues.apache.org/jira/browse/SPARK-10577
>             Project: Spark
>          Issue Type: Improvement
>          Components: PySpark, SQL
>    Affects Versions: 1.5.0
>            Reporter: Maciej Bryński
>
> As in https://issues.apache.org/jira/browse/SPARK-8300
> there should by possibility to add hint for broadcast join in:
> - Spark SQL
> - Pyspark



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message