spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Or (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (SPARK-14619) Track internal accumulators (metrics) by stage attempt rather than stage
Date Thu, 14 Apr 2016 17:55:25 GMT

     [ https://issues.apache.org/jira/browse/SPARK-14619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Andrew Or resolved SPARK-14619.
-------------------------------
    Resolution: Fixed

> Track internal accumulators (metrics) by stage attempt rather than stage
> ------------------------------------------------------------------------
>
>                 Key: SPARK-14619
>                 URL: https://issues.apache.org/jira/browse/SPARK-14619
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Spark Core
>            Reporter: Reynold Xin
>            Assignee: Reynold Xin
>             Fix For: 2.0.0
>
>
> When there are multiple attempts for a stage, we currently only reset internal accumulator
values if all the tasks are resubmitted. It would make more sense to reset the accumulator
values for each stage attempt. This will allow us to eventually get rid of the internal flag
in the Accumulator class.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message