spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Graves (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting
Date Wed, 20 Dec 2017 18:20:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298854#comment-16298854
] 

Thomas Graves commented on SPARK-22577:
---------------------------------------

Yes I was thinking the stage UI (and perhaps executor UI). The executors table there already
has a blacklist column it would be nice to fill in. People find it confusing that it says
0 when really the executor is blacklisted at the taskset level.  So perhaps it can be confusing
either way but I would rather show users what is actually going on.   


> executor page blacklist status should update with TaskSet level blacklisting
> ----------------------------------------------------------------------------
>
>                 Key: SPARK-22577
>                 URL: https://issues.apache.org/jira/browse/SPARK-22577
>             Project: Spark
>          Issue Type: Bug
>          Components: Scheduler
>    Affects Versions: 2.1.1
>            Reporter: Thomas Graves
>
> right now the executor blacklist status only updates with the BlacklistTracker after
a task set has finished and propagated the blacklisting to the application level. We should
change that to show at the taskset level as well. Without this it can be very confusing to
the user why things aren't running.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message