flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Piotr Nowojski <pi...@data-artisans.com>
Subject Re: Watermark through Rest Api
Date Tue, 09 Oct 2018 06:51:34 GMT

Watermarks are tracked per Task/Operator level:

https://ci.apache.org/projects/flink/flink-docs-stable/monitoring/metrics.html#io <https://ci.apache.org/projects/flink/flink-docs-stable/monitoring/metrics.html#io>

Tracking watermarks on the job level would be problematic, since it would require some kind
of aggregation (min? Avg?) of all of the operators.


> On 9 Oct 2018, at 02:13, Gregory Fee <gfee@lyft.com> wrote:
> Hello! I am interested in getting the current low watermark for tasks
> in my Flink jobs. I know how to see them in the UI. I'm interested in
> getting them programmatically, hopefully via rest api. The
> documentation says that they are exposed as metrics but I don't see
> watermark info in the 'metrics' section in the job detail. Does anyone
> know how I might get the watermark information?
> Thanks,
> -- 
> Gregory Fee
> Engineer

View raw message