flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Greg Hogan <c...@greghogan.com>
Subject Re: Improving Flink performance
Date Mon, 23 Jan 2017 16:20:41 GMT
Hi Jonas,

It looks like the mailing list has removed your formatting and/or
attachments.

Greg

On Mon, Jan 23, 2017 at 6:08 AM, Jonas <jonas@huntun.de> wrote:

> Hello!
>
> I'm having performance problems with a Flink job. If there is anything
> valuable missing, please ask and I will try to answer ASAP. My job looks
> like this:
>
>
>
> First, I read data from Kafka. This is very fast at 100k msgs/s. The data
> is
> decoded, a type is added (we have multiple message types per Kafka topic).
> Then we select the TYPE_A messages, create a Scala entity out of if (a case
> class). Afterwards in the MapEntityToMultipleEntities the Scala entities
> are
> split into multiple. Finally a watermark is added.
>
> As you can see the data is not keyed in any way yet. *Is there a way to
> make
> this faster?*
>
>
> /Measurements were taken with
>
> and /
>
>
>
> --
> View this message in context: http://apache-flink-user-
> mailing-list-archive.2336050.n4.nabble.com/Improving-Flink-
> performance-tp11211.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive
> at Nabble.com.
>

Mime
View raw message