spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Patrick Wendell (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-2501) Handle stage re-submissions properly in the UI
Date Wed, 16 Jul 2014 00:53:06 GMT

    [ https://issues.apache.org/jira/browse/SPARK-2501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062950#comment-14062950
] 

Patrick Wendell commented on SPARK-2501:
----------------------------------------

Our handling of stage re-submissions is broken in the UI. For instance, I looked in the JobProgressListener
and we index many things on StageId that might better be indexed on StageId, AttemptId. Also,
we should probably give the AttemptId when start a task so that we understand which stage
attempt to associated it with. I also don't understand exactly what happens when a stage gets
re-attempted, do we send a "stage completed" event? It might be good to fix the way we deal
with stage re-submissions to make this work better overall.

> Handle stage re-submissions properly in the UI
> ----------------------------------------------
>
>                 Key: SPARK-2501
>                 URL: https://issues.apache.org/jira/browse/SPARK-2501
>             Project: Spark
>          Issue Type: Bug
>          Components: Web UI
>            Reporter: Patrick Wendell
>            Assignee: Masayoshi TSUZUKI
>            Priority: Critical
>




--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message