spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nicholas Parker (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-24501) Add metrics for Mesos Driver and Dispatcher
Date Fri, 08 Jun 2018 23:48:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-24501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506709#comment-16506709
] 

Nicholas Parker commented on SPARK-24501:
-----------------------------------------

PR: https://github.com/apache/spark/pull/21516

> Add metrics for Mesos Driver and Dispatcher
> -------------------------------------------
>
>                 Key: SPARK-24501
>                 URL: https://issues.apache.org/jira/browse/SPARK-24501
>             Project: Spark
>          Issue Type: Improvement
>          Components: Mesos
>    Affects Versions: 2.3.1
>            Reporter: Nicholas Parker
>            Priority: Minor
>
> The Mesos Dispatcher currently only has three gauge metrics, for the number of waiting,
launched, and retrying drivers, defined in MesosClusterSchedulerSource.scala. Meanwhile, the
Mesos Driver doesn't have any metrics defined at all.
> Implement additional metrics for both the Mesos Dispatcher and Mesos Driver, including
e.g. types of events received, how long it takes jobs to run, for use by operators to monitor
and/or diagnose their Spark environment.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message