spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Derek Dagit (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-11185) Add more task metrics to the "all Stages Page"
Date Mon, 28 Dec 2015 16:16:49 GMT

    [ https://issues.apache.org/jira/browse/SPARK-11185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15072870#comment-15072870
] 

Derek Dagit commented on SPARK-11185:
-------------------------------------

[~pwendell], [~kayousterhout], [~andrewor14], [~irashid]

Let's figure out how we might address this use case. Do we think there is a way to present
this information without cluttering the UI?



> Add more task metrics to the "all Stages Page"
> ----------------------------------------------
>
>                 Key: SPARK-11185
>                 URL: https://issues.apache.org/jira/browse/SPARK-11185
>             Project: Spark
>          Issue Type: Improvement
>          Components: Web UI
>    Affects Versions: 1.5.1
>            Reporter: Thomas Graves
>
> The "All Stages Page" on the History page could have more information about the stage
to allow users to quickly see which stage potentially has long tasks. Indicator or skewed
data or bad nodes, etc.  
> Currently to get this information you have to click on every stage.  If you have a hundreds
of stages this can be very cumbersome.
> For instance pulling out the max task time and the median to the all stages page would
allow me to see the difference and if the max task time is much greater then the median this
stage may have had tasks with problems.  
> We already had some discussion about this under https://github.com/apache/spark/pull/9051



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message