flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kurt Young <ykt...@gmail.com>
Subject Re: Local combiner on each mapper in Flink
Date Tue, 24 Oct 2017 09:14:57 GMT
I think you can use WindowedStream.aggreate

Best,
Kurt

On Tue, Oct 24, 2017 at 1:45 PM, Le Xu <sharonxu65@gmail.com> wrote:

> Thanks Kurt. Maybe I wasn't clear before, I was wondering if Flink has
> implementation of combiner in DataStream (to use after keyBy and windowing).
>
> Thanks again!
>
> Le
>
> On Sun, Oct 22, 2017 at 8:52 PM, Kurt Young <ykt836@gmail.com> wrote:
>
>> Hi,
>>
>> The document you are looking at is pretty old, you can check the newest
>> version here: https://ci.apache.org/projects/flink/flink-docs-releas
>> e-1.3/dev/batch/dataset_transformations.html
>>
>> Regarding to your question, you can use combineGroup
>>
>> Best,
>> Kurt
>>
>> On Mon, Oct 23, 2017 at 5:22 AM, Le Xu <sharonxu65@gmail.com> wrote:
>>
>>> Hello!
>>>
>>> I'm new to Flink and I'm wondering if there is a explicit local combiner
>>> to each mapper so I can use to perform a local reduce on each mapper? I
>>> looked up on https://ci.apache.org/projects/flink/flink-docs-release-0
>>> .8/dataset_transformations.html but couldn't find anything that matches.
>>>
>>>
>>> Thanks!
>>>
>>> Le
>>>
>>
>>
>

Mime
View raw message