spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (SPARK-13281) Switch broadcast of RDD to exception from warning
Date Wed, 16 Mar 2016 16:12:33 GMT

     [ https://issues.apache.org/jira/browse/SPARK-13281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sean Owen resolved SPARK-13281.
-------------------------------
       Resolution: Fixed
    Fix Version/s: 2.0.0

Issue resolved by pull request 11735
[https://github.com/apache/spark/pull/11735]

> Switch broadcast of RDD to exception from warning
> -------------------------------------------------
>
>                 Key: SPARK-13281
>                 URL: https://issues.apache.org/jira/browse/SPARK-13281
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>            Reporter: holdenk
>            Priority: Trivial
>             Fix For: 2.0.0
>
>
> In the comments we log a warning when a user tries to broadcast an RDD for compatibility
with old programs which may have broadcast RDDs without using the resulting broadcast variable.
Since we're moving to 2.0 it seems like now would be a good opportunity to replace that warning
with an exception rather than depend on the developer finding the warning message.
> Related to https://issues.apache.org/jira/browse/SPARK-5063 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message