flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From prateekarora <prateek.arora...@gmail.com>
Subject Re: Flink Kafka Streaming - Source [Bytes/records Received] and Sink [Bytes/records sent] show zero messages
Date Mon, 16 May 2016 21:43:19 GMT
thanks for the information .
I want to collect some performance metrics like throughput , latency etc
.thats why looking for these data to collect some information .

how can i collect some performance data in flink  ?

Regards
Prateek


On Mon, May 16, 2016 at 2:32 PM, Fabian Hueske-2 [via Apache Flink User
Mailing List archive.] <ml-node+s2336050n6944h94@n4.nabble.com> wrote:

> Hi Prateek,
>
> the missing numbers are an artifact from how the stats are collected.
> ATM, Flink does only collect these metrics for data which is sent over
> connections *between* Flink operators.
> Since sources and sinks connect to external systems (and not Flink
> operators), the dash board does not show receiving byte for sources and
> sent bytes for sinks.
>
> Best, Fabian
>
> 2016-05-16 23:02 GMT+02:00 prateekarora <[hidden email]
> <http:///user/SendEmail.jtp?type=node&node=6944&i=0>>:
>
>> Hi
>>
>> In my flink kafka streaming application i am fetching data from one topic
>> and then process and sent to output topic . my application is working fine
>> but  flink dashboard shows Source [Bytes/records Received]  and Sink
>> [Bytes/records sent] is zero.
>>
>>
>> Duration  Name                             Bytes            Records
>>        Bytes
>> Records       Status
>>                                                   Received      Received
>> sent           sent
>> 3m 15s    Source: Custom Source   0 B              0
>>  249 MB
>> 3,540       RUNNING
>>
>>
>> 3m 15s    Map -> Sink: Unnamed    203 MB         2,883         0 B
>>           0
>> RUNNING
>>
>>
>>
>> <
>> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/file/n6941/flink-kafka.png
>> >
>>
>> what is the reason for not showing correct number ?
>>
>> Regards
>> Prateek
>>
>>
>>
>>
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Kafka-Streaming-Source-Bytes-records-Received-and-Sink-Bytes-records-sent-show-zero-messages-tp6941.html
>> Sent from the Apache Flink User Mailing List archive. mailing list
>> archive at Nabble.com.
>>
>
>
>
> ------------------------------
> If you reply to this email, your message will be added to the discussion
> below:
>
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Kafka-Streaming-Source-Bytes-records-Received-and-Sink-Bytes-records-sent-show-zero-messages-tp6941p6944.html
> To unsubscribe from Flink Kafka Streaming - Source [Bytes/records
> Received] and Sink [Bytes/records sent] show zero messages, click here
> <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=6941&code=cHJhdGVlay5hcm9yYTJrNkBnbWFpbC5jb218Njk0MXwtOTMxMzI0ODYx>
> .
> NAML
> <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>




--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Kafka-Streaming-Source-Bytes-records-Received-and-Sink-Bytes-records-sent-show-zero-messages-tp6941p6945.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.
Mime
View raw message