flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephan Ewen <se...@apache.org>
Subject Re: benchmarking flink streaming
Date Fri, 16 Dec 2016 15:36:59 GMT
Hi!

I am not sure there exists a recommended benchmarking tool. Performance
comparisons depend heavily on the scenarios you are looking at: Simple
event processing, shuffles (grouping aggregation), joins, small state,
large state, etc...

As fas as I know, most people try to write a "mock" version of a job that
is representative for the jobs they want to run, and test with that.

That said, I agree that it would actually be helpful to collect some jobs
in a form of "evaluation suite".

Stephan



On Thu, Dec 15, 2016 at 6:11 PM, Meghashyam Sandeep V <
vr1meghashyam@gmail.com> wrote:

> Hi There,
>
> We are evaluating Flink streaming for real time data analysis. I have my
> flink job running in EMR with Yarn. What are the possible benchmarking
> tools that work best with Flink? I couldn't find this information in the
> Apache website.
>
> Thanks,
> Sandeep
>

Mime
View raw message