flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dhruv Gohil <yourfrienddh...@gmail.com>
Subject Re: How to measure Flink performance
Date Fri, 13 May 2016 06:07:12 GMT
Hi Prateek,

https://github.com/dataArtisans/yahoo-streaming-benchmark/blob/master/flink-benchmarks/src/main/java/flink/benchmark/utils/ThroughputLogger.java
https://github.com/dataArtisans/yahoo-streaming-benchmark/blob/master/flink-benchmarks/src/main/java/flink/benchmark/utils/AnalyzeTool.java

help you measure  throughput and latency both, from within topology.

On Thursday 12 May 2016 11:21 PM, Konstantin Knauf wrote:
> Hi Prateek,
>
> regarding throughput, what about simply filling the input Kafka topic
> with some (a lot) of messages and monitor (e.g.
> http://quantifind.github.io/KafkaOffsetMonitor/) how quickly Flink can
> work the lag off. The messages should be representative of your use
> case, of course.
>
> Latency is harder, I think, and I would also be interested in the
> approaches of others to measure latency in Flink.
>
> To some extend, you could do it by adding some logging inside Flink, but
> this effects latency and only measure latency whithin Flink (excluding
> reading from source and writing to sink).
>
> Cheers,
>
> Konstantin
>
> On 12.05.2016 18:57, prateekarora wrote:
>> Hi
>>
>> How can i measure  throughput and latency  of my application in flink 1.0.2
>> ?
>>
>> Regards
>> Prateek
>>
>>
>>
>> --
>> View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/How-to-measure-Flink-performance-tp6741p6863.html
>> Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.
>>


Mime
View raw message