spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stavros Kontopoulos (JIRA)" <>
Subject [jira] [Created] (SPARK-25394) Expose App status metrics as Source
Date Mon, 10 Sep 2018 13:38:00 GMT
Stavros Kontopoulos created SPARK-25394:

             Summary: Expose App status metrics as Source
                 Key: SPARK-25394
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core
    Affects Versions: 2.4.0
            Reporter: Stavros Kontopoulos

ApplicationListener in Spark core captures useful metrics like job duration which are exposed
via the spark rest api (available both at the driver's ui and the history server ui) only.
From a devops perspective and especially on k8s where metrics scrapping is often done via
the prometheus jmx exporter it would be good to have all metrics in one place.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message