spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-12847) Remove StreamingListenerBus and post all Streaming events to the same thread as Spark events
Date Fri, 15 Jan 2016 23:57:40 GMT

    [ https://issues.apache.org/jira/browse/SPARK-12847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15102728#comment-15102728
] 

Apache Spark commented on SPARK-12847:
--------------------------------------

User 'zsxwing' has created a pull request for this issue:
https://github.com/apache/spark/pull/10779

> Remove StreamingListenerBus and post all Streaming events to the same thread as Spark
events
> --------------------------------------------------------------------------------------------
>
>                 Key: SPARK-12847
>                 URL: https://issues.apache.org/jira/browse/SPARK-12847
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core, Streaming
>            Reporter: Shixiong Zhu
>            Assignee: Shixiong Zhu
>
> SparkListener.onOtherEvent  was added in https://github.com/apache/spark/pull/10061.
SQLListener uses it to dispatch SQL special events instead of creating a new separate listener
bus.
> Streaming can also use the similar approach to eliminate the StreamingListenerBus. Right
now, nondeterministic message order in two listener buses are really tricky when someone implements
both SparkListener and StreamingListener. And if we can use only one listener bus in Spark,
the nondeterministic message order will be eliminated and we can also remove a lot of codes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message