flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chesnay Schepler <ches...@apache.org>
Subject Re: Flink sent/received bytes related metrics: how are they calculated?
Date Fri, 14 Jun 2019 09:08:34 GMT
Which version of Flink are you using? There were some issues at some 
point about double-counting.

On 14/06/2019 09:49, Andrea Spina wrote:
> Dear Community, I'd like to ask for some details about bytes related 
> metrics in Flink. Precisely, I'm looking at *bytes sent* and *bytes 
> received *metrics: what I am recording is the following:
> I am reading from a Kafka topic *A* records with schema *K* using a 
> source *Sin *belonging to a pipeline *P1*. The topic *A* is filled 
> with *K* data using a separated pipeline *p2* and a sink *Sout*.
> Basically what I register is that the /bytes sent/ metric of 
> *Sin* - available through the Flink UI -measure twice or more respect 
> of the /bytes received/ of *Sout. *For instance, if my sink Sout 
> records 10GB of /bytes received/ inbound, then my source Sin emits 
> between 20-25GB /bytes sent/.
> Screenshot 2019-06-14 at 09.40.08.png
> Is someone able to detail how these two metrics are calculated?
> Thank you,
> -- 
> *Andrea Spina*
> Software Engineer @ Radicalbit Srl
> Via Borsieri 41, 20159, Milano - IT

View raw message