spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Patrick Wendell (JIRA)" <>
Subject [jira] [Commented] (SPARK-2501) Handle stage re-submissions properly in the UI
Date Wed, 16 Jul 2014 00:53:06 GMT


Patrick Wendell commented on SPARK-2501:

Our handling of stage re-submissions is broken in the UI. For instance, I looked in the JobProgressListener
and we index many things on StageId that might better be indexed on StageId, AttemptId. Also,
we should probably give the AttemptId when start a task so that we understand which stage
attempt to associated it with. I also don't understand exactly what happens when a stage gets
re-attempted, do we send a "stage completed" event? It might be good to fix the way we deal
with stage re-submissions to make this work better overall.

> Handle stage re-submissions properly in the UI
> ----------------------------------------------
>                 Key: SPARK-2501
>                 URL:
>             Project: Spark
>          Issue Type: Bug
>          Components: Web UI
>            Reporter: Patrick Wendell
>            Assignee: Masayoshi TSUZUKI
>            Priority: Critical

This message was sent by Atlassian JIRA

View raw message