spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-6036) EventLog process logic has race condition with Akka actor system
Date Thu, 26 Feb 2015 09:35:04 GMT

    [ https://issues.apache.org/jira/browse/SPARK-6036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14338152#comment-14338152
] 

Apache Spark commented on SPARK-6036:
-------------------------------------

User 'liyezhang556520' has created a pull request for this issue:
https://github.com/apache/spark/pull/4785

> EventLog process logic has race condition with Akka actor system
> ----------------------------------------------------------------
>
>                 Key: SPARK-6036
>                 URL: https://issues.apache.org/jira/browse/SPARK-6036
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core, Web UI
>    Affects Versions: 1.3.0
>            Reporter: Zhang, Liye
>
> when application finished, akka actor system will trigger disassociated event, and Master
will rebuild SparkUI on web, in which progress will check whether the eventlog files are still
in progress. The current logic in SparkContext is first stop the actorsystem, and then stop
enentLogListener. This will cause that the enentLogListener has not finished renaming the
eventLog dir name (from app-xxxx.inprogress to app-xxxx)  when Spark Master try to access
the dir. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message