flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephan Ewen <se...@apache.org>
Subject Re: Adding a serial collection-based execution mode
Date Mon, 22 Sep 2014 23:28:31 GMT
What do you think of changing the TestBase such that all new test programs
are not only executed with the LocalExecutor, but also with the Collection
execution environment? Would give us massive coverage for the collection
execution for free...

On Mon, Sep 22, 2014 at 11:09 PM, Stephan Ewen <sewen@apache.org> wrote:

> Will do mapPartition...
>
> On Mon, Sep 22, 2014 at 7:34 PM, Ufuk Celebi <uce@apache.org> wrote:
>
>>
>> On 22 Sep 2014, at 19:08, Stephan Ewen <sewen@apache.org> wrote:
>>
>> > I'll take "cross". Need it for tests...
>> >
>> > On Mon, Sep 22, 2014 at 5:48 PM, Stephan Ewen <sewen@apache.org> wrote:
>> >
>> >> Hi!
>> >>
>> >> I added a new branch (collections2) that includes the commit moving the
>> >> typeutils to "flink-core" and including the code for the runtime
>> context.
>> >>
>> >> Those who need any of that, please rebase your branch...
>> >>
>> >> Stephan
>> >>
>> >>
>> >> On Mon, Sep 22, 2014 at 4:33 PM, Aljoscha Krettek <aljoscha@apache.org
>> >
>> >> wrote:
>> >>
>> >>> I'll do groupReduce
>> >>>
>> >>> On Mon, Sep 22, 2014 at 4:13 PM, Till Rohrmann <
>> till.rohrmann@gmail.com>
>> >>> wrote:
>> >>>> Then I'll take the join operation.
>> >>>>
>> >>>> On Mon, Sep 22, 2014 at 3:44 PM, Ufuk Celebi <uce@apache.org>
wrote:
>> >>>>
>> >>>>>
>> >>>>> On 22 Sep 2014, at 15:37, Stephan Ewen <sewen@apache.org>
wrote:
>> >>>>>
>> >>>>>> Hi everyone!
>> >>>>>>
>> >>>>>> I have started with a patch that introduces *"local
>> collection-based
>> >>>>>> execution"* of Flink programs.
>> >>>>>
>> >>>>> Very nice!
>> >>>>>
>> >>>>> To have a list of missing operators:
>> >>>>>
>> >>>>> - flatMap <= I'll take this
>> >>>>> - filter <= I'll take this
>> >>>>> - reduce <= I'll take this
>> >>>>> - groupreduce
>> >>>>> - cogroup
>> >>>>> - join
>> >>>>>
>>
>> Aljoscha did the reduce. I will do CoGroup.
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message