flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Fabian Hueske <fhue...@gmail.com>
Subject Re: Flink Kafka Streaming - Source [Bytes/records Received] and Sink [Bytes/records sent] show zero messages
Date Mon, 16 May 2016 22:07:38 GMT
Hi Prateek,

the missing numbers are an artifact from how the stats are collected.
ATM, Flink does only collect these metrics for data which is sent over
connections *between* Flink operators.
Since sources and sinks connect to external systems (and not Flink
operators), the dash board does not show receiving byte for sources and
sent bytes for sinks.

Best, Fabian

2016-05-16 23:02 GMT+02:00 prateekarora <prateek.arora2k6@gmail.com>:

> Hi
>
> In my flink kafka streaming application i am fetching data from one topic
> and then process and sent to output topic . my application is working fine
> but  flink dashboard shows Source [Bytes/records Received]  and Sink
> [Bytes/records sent] is zero.
>
>
> Duration  Name                             Bytes            Records
>      Bytes
> Records       Status
>                                                   Received      Received
> sent           sent
> 3m 15s    Source: Custom Source   0 B              0                   249
> MB
> 3,540       RUNNING
>
>
> 3m 15s    Map -> Sink: Unnamed    203 MB         2,883         0 B
>           0
> RUNNING
>
>
>
> <
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/file/n6941/flink-kafka.png
> >
>
> what is the reason for not showing correct number ?
>
> Regards
> Prateek
>
>
>
>
>
>
>
> --
> View this message in context:
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Kafka-Streaming-Source-Bytes-records-Received-and-Sink-Bytes-records-sent-show-zero-messages-tp6941.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive
> at Nabble.com.
>

Mime
View raw message