flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hequn Cheng <chenghe...@gmail.com>
Subject Re: Measure Latency from source to sink
Date Tue, 26 Jun 2018 01:22:55 GMT
Hi antonio,

I see two options to solve your problem.
1. Enable the latency tracking[1]. But you have to pay attention to it's
mechanism, for example, a) the sources only *periodically* emit a special
record and b) the latency markers are not accounting for the time user
records spend in operators as they are bypassing them.
2. Add a time field to each of your record. Each time a record comes in
from the source, write down the time(t1), so that we can get the latency at
sink(t2) by  t2 - t1.

Hope this helps.
Hequn

[1]
https://ci.apache.org/projects/flink/flink-docs-master/monitoring/metrics.html#latency-tracking

On Tue, Jun 26, 2018 at 5:23 AM, antonio saldivar <ansale10@gmail.com>
wrote:

> Hello
>
> I am trying to measure the latency of each transaction traveling across
> the system as a DataSource I have a Kafka consumer and I would like to
> measure the time that takes from the Source to Sink. Does any one has an
> example?.
>
> Thank you
> Best Regards
>

Mime
View raw message