spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shixiong Zhu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-24748) Support for reporting custom metrics via Streaming Query Progress
Date Wed, 05 Sep 2018 06:02:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-24748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Shixiong Zhu updated SPARK-24748:
---------------------------------
    Fix Version/s:     (was: 2.4.0)

> Support for reporting custom metrics via Streaming Query Progress
> -----------------------------------------------------------------
>
>                 Key: SPARK-24748
>                 URL: https://issues.apache.org/jira/browse/SPARK-24748
>             Project: Spark
>          Issue Type: Improvement
>          Components: Structured Streaming
>    Affects Versions: 2.3.1
>            Reporter: Arun Mahadevan
>            Priority: Major
>
> Currently the Structured Streaming sources and sinks does not have a way to report custom
metrics. Providing an option to report custom metrics and making it available via Streaming
Query progress can enable sources and sinks to report custom progress information (E.g. the
lag metrics for Kafka source).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message