Return-Path: X-Original-To: apmail-flink-user-archive@minotaur.apache.org Delivered-To: apmail-flink-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 919CE1795B for ; Tue, 14 Apr 2015 13:12:23 +0000 (UTC) Received: (qmail 71358 invoked by uid 500); 14 Apr 2015 13:12:23 -0000 Delivered-To: apmail-flink-user-archive@flink.apache.org Received: (qmail 71294 invoked by uid 500); 14 Apr 2015 13:12:23 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flink.apache.org Delivered-To: mailing list user@flink.apache.org Received: (qmail 71284 invoked by uid 99); 14 Apr 2015 13:12:23 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Apr 2015 13:12:23 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of ewenstephan@gmail.com designates 209.85.213.172 as permitted sender) Received: from [209.85.213.172] (HELO mail-ig0-f172.google.com) (209.85.213.172) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Apr 2015 13:11:58 +0000 Received: by igblo3 with SMTP id lo3so13828670igb.0 for ; Tue, 14 Apr 2015 06:11:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:content-type; bh=qfNNaj6kJgqsY2EmAKELoQoIRBgtY1WhQN/c+m5sI+8=; b=XL/WOFNTGkCbvmDD8ZTaEvB6Vnua3BPQ5I9ULgcQ0EOcSshL7NqqFnnGaPH/jdRjhe 1TiXJNtCIbKapvHr+TmjWMCPfR49u3JSusGrCTwpOf9+Ei8IsLeqOgUCZOfTOpm36DvS Ak0KpmbOLn2rUdomuofUboDFC4y1Bt5SDaMN6ibiiSEZBBlmCK7eDXUaRJ11vIDUDQ1q svYaeajcLP4KH2wi9uzQBVoF9eXHkhNujPl1s83z7fpHGtOogE6I0LDrjU62gQ7OCHEK pgPo4z+khG0AMabiLi7uLNXjnRWzffPE2ax+mPkEQkXabUSIJoS1SON5DTewc+Bfhr4f jttA== MIME-Version: 1.0 X-Received: by 10.42.167.8 with SMTP id q8mr25528077icy.94.1429017116647; Tue, 14 Apr 2015 06:11:56 -0700 (PDT) Sender: ewenstephan@gmail.com Received: by 10.64.76.130 with HTTP; Tue, 14 Apr 2015 06:11:56 -0700 (PDT) In-Reply-To: References: Date: Tue, 14 Apr 2015 15:11:56 +0200 X-Google-Sender-Auth: OQA1crhBOx8oPAVUlTyRrPauG3k Message-ID: Subject: Re: Nested Iterations supported in Flink? From: Stephan Ewen To: user@flink.apache.org Content-Type: multipart/alternative; boundary=90e6ba6e83c49da9f20513aef961 X-Virus-Checked: Checked by ClamAV on apache.org --90e6ba6e83c49da9f20513aef961 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Beno=C3=AEt! You are right, the nested iterations are currently not supported. The test you found actually checks that the Optimizer gives a good error message when encountering nested iterations. Can you write your program as one iterations (the inner) and start the program multiple times to simulate the nesting? Greetings, Stephan On Tue, Apr 14, 2015 at 8:11 AM, Beno=C3=AEt Hanotte < benoit.jc.hanotte@campus.tu-berlin.de> wrote: > Hello, > > I'm implementing an algorithm which requires nested iterations, and, from > what I understood, this feature was not yet available in Flink [1], and m= y > experiments with 2 nested bulk iterations seem to confirm that. However I > came across a Flink unit test [2] using nested iterations, so I'm now a b= it > confused. Could you please give me some insight on what is supported or n= ot > in the current state of the project? > > Thanks! > > Beno=C3=AEt. > > [1] http://mail-archives.apache.org/mod_mbox/flink-user/ > 201411.mbox/%3CCANC1h_tpNFWwrnm14+Et1yBvkQPQ1-pfk=3D > iUPP5Un90ZgUGeyg@mail.gmail.com%3E > [2] https://github.com/apache/flink/blob/master/flink- > optimizer/src/test/java/org/apache/flink/optimizer/ > NestedIterationsTest.java > --90e6ba6e83c49da9f20513aef961 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi Beno=C3=AEt!

You are right, the nest= ed iterations are currently not supported.

The tes= t you found actually checks that the Optimizer gives a good error message w= hen encountering nested iterations.

Can you write = your program as one iterations (the inner) and start the program multiple t= imes to simulate the nesting?

Greetings,
Stephan


On Tue, Apr 14, 2015 at 8:11 AM, Beno=C3=AEt Hanotte <benoit.jc.hanotte@campus.tu-berlin.de> wrot= e:
Hello,

I'm implementing an algorithm which requires nested iterations, and, fr= om what I understood, this feature was not yet available in Flink [1], and = my experiments with 2 nested bulk iterations seem to confirm that. However = I came across a Flink unit test [2] using nested iterations, so I'm now= a bit confused. Could you please give me some insight on what is supported= or not in the current state of the project?

Thanks!

Beno=C3=AEt.

[1] http://mail-archives.apache.org/mod_mbox/flin= k-user/201411.mbox/%3CCANC1h_tpNFWwrnm14+Et1yBvkQPQ1-pfk=3DiUPP5Un90ZgUGeyg@mail.gmail.com%3E
[2] https://github.com/apache/flink/blob/master/flink-optimizer/src/test/java/org/apache/flink/optimizer/NestedIte= rationsTest.java

--90e6ba6e83c49da9f20513aef961--