spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (SPARK-17894) Ensure uniqueness of TaskSetManager name
Date Thu, 13 Oct 2016 11:50:20 GMT

     [ https://issues.apache.org/jira/browse/SPARK-17894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Apache Spark reassigned SPARK-17894:
------------------------------------

    Assignee:     (was: Apache Spark)

> Ensure uniqueness of TaskSetManager name
> ----------------------------------------
>
>                 Key: SPARK-17894
>                 URL: https://issues.apache.org/jira/browse/SPARK-17894
>             Project: Spark
>          Issue Type: Bug
>          Components: Scheduler
>    Affects Versions: 2.1.0
>            Reporter: Eren Avsarogullari
>
> TaskSetManager should have unique name to avoid adding duplicate ones to *Pool* via *SchedulableBuilder*.
This problem surfaced with https://issues.apache.org/jira/browse/SPARK-17759 and please find
discussion: https://github.com/apache/spark/pull/15326
> *Proposal* :
> There is 1x1 relationship between Stage Attempt Id and TaskSetManager so taskSet.Id covering
both stageId and stageAttemptId looks to be used for TaskSetManager as well. 
> *Current TaskSetManager Name* : 
> {code:java} var name = "TaskSet_" + taskSet.stageId.toString{code}
> *Sample*: TaskSet_0
> *Proposed TaskSetManager Name* : 
> {code:java} var name = "TaskSet_" + taskSet.Id (stageId + "." + stageAttemptId) {code}
> *Sample* : TaskSet_0.0
> cc [~kayousterhout] [~markhamstra]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message