Return-Path: X-Original-To: apmail-flink-dev-archive@www.apache.org Delivered-To: apmail-flink-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 109D517560 for ; Fri, 20 Feb 2015 15:52:39 +0000 (UTC) Received: (qmail 54091 invoked by uid 500); 20 Feb 2015 15:52:39 -0000 Delivered-To: apmail-flink-dev-archive@flink.apache.org Received: (qmail 54031 invoked by uid 500); 20 Feb 2015 15:52:38 -0000 Mailing-List: contact dev-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list dev@flink.apache.org Received: (qmail 54017 invoked by uid 99); 20 Feb 2015 15:52:38 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 Feb 2015 15:52:38 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of alexander.s.alexandrov@gmail.com designates 209.85.217.170 as permitted sender) Received: from [209.85.217.170] (HELO mail-lb0-f170.google.com) (209.85.217.170) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 Feb 2015 15:52:13 +0000 Received: by lbdu14 with SMTP id u14so7063954lbd.1 for ; Fri, 20 Feb 2015 07:50:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=IWroGgAkW6ClxFGaIZ+FgTorJ4AsH8meoHAc/+geVEg=; b=qeqjG8aTYgdib26QpTdqzs55jR3JV4TnxYUmO/CGEJVtV/ynvw7IjfNUv7dngFBFle aaKI1UIkAM1p7tC1hZ5fzADttRDYgP2snk4pbfnc7if9JyarJjjd5ZVBNDs/7oRdqET/ qWr5+bilKstWZC52/s/SKidKvafBQBAA/bKPa2YRIEiJq0M4NNjuOUkdJo2liEfjvKbF cUsK9Rr/TPpikXZXrv6AweU303sEntWYsrjHa9U1wVybgnuW4jRFXuKlAQ+ILlADPXA0 w6S9Hwc49veFL2nrjDV4QeaIlW01mBW8McfK3uvoTxkWRsPwluKVnySUWVzKXIviS7zR RaOg== MIME-Version: 1.0 X-Received: by 10.112.110.103 with SMTP id hz7mr9251482lbb.62.1424447441925; Fri, 20 Feb 2015 07:50:41 -0800 (PST) Received: by 10.112.33.131 with HTTP; Fri, 20 Feb 2015 07:50:41 -0800 (PST) In-Reply-To: References: Date: Fri, 20 Feb 2015 16:50:41 +0100 Message-ID: Subject: Re: [jira] [Created] (FLINK-1594) DataStreams don't support self-join From: Alexander Alexandrov To: dev@flink.apache.org Cc: dev@flink.incubator.apache.org Content-Type: multipart/alternative; boundary=001a1134dea2c6f88c050f8703e1 X-Virus-Checked: Checked by ClamAV on apache.org --001a1134dea2c6f88c050f8703e1 Content-Type: text/plain; charset=UTF-8 I guess the intended behavior here is to just throw a nicer error, as you cannot really join two data streams. 2015-02-20 16:41 GMT+01:00 Daniel Bali (JIRA) : > Daniel Bali created FLINK-1594: > ---------------------------------- > > Summary: DataStreams don't support self-join > Key: FLINK-1594 > URL: https://issues.apache.org/jira/browse/FLINK-1594 > Project: Flink > Issue Type: Bug > Components: Streaming > Affects Versions: 0.9 > Environment: flink-0.9.0-SNAPSHOT > Reporter: Daniel Bali > > > Trying to join a DataSets with itself will result in exceptions. I get the > following stack trace: > > {noformat} > java.lang.Exception: Error setting up runtime environment: Union > buffer reader must be initialized with at least two individual buffer > readers > at > org.apache.flink.runtime.execution.RuntimeEnvironment.(RuntimeEnvironment.java:173) > at org.apache.flink.runtime.taskmanager.TaskManager.org > $apache$flink$runtime$taskmanager$TaskManager$$submitTask(TaskManager.scala:419) > at > org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$receiveWithLogMessages$1.applyOrElse(TaskManager.scala:261) > at > scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33) > at > scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33) > at > scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25) > at > org.apache.flink.runtime.ActorLogMessages$$anon$1.apply(ActorLogMessages.scala:44) > at > org.apache.flink.runtime.ActorLogMessages$$anon$1.apply(ActorLogMessages.scala:30) > at > scala.PartialFunction$class.applyOrElse(PartialFunction.scala:118) > at > org.apache.flink.runtime.ActorLogMessages$$anon$1.applyOrElse(ActorLogMessages.scala:30) > at akka.actor.Actor$class.aroundReceive(Actor.scala:465) > at > org.apache.flink.runtime.taskmanager.TaskManager.aroundReceive(TaskManager.scala:89) > at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516) > at akka.actor.ActorCell.invoke(ActorCell.scala:487) > at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:254) > at akka.dispatch.Mailbox.run(Mailbox.scala:221) > at akka.dispatch.Mailbox.exec(Mailbox.scala:231) > at > scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) > at > scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) > at > scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) > at > scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) > Caused by: java.lang.IllegalArgumentException: Union buffer reader > must be initialized with at least two individual buffer readers > at > org.apache.flink.shaded.com.google.common.base.Preconditions.checkArgument(Preconditions.java:125) > at > org.apache.flink.runtime.io.network.api.reader.UnionBufferReader.(UnionBufferReader.java:69) > at > org.apache.flink.streaming.api.streamvertex.CoStreamVertex.setConfigInputs(CoStreamVertex.java:101) > at > org.apache.flink.streaming.api.streamvertex.CoStreamVertex.setInputsOutputs(CoStreamVertex.java:63) > at > org.apache.flink.streaming.api.streamvertex.StreamVertex.registerInputOutput(StreamVertex.java:65) > at > org.apache.flink.runtime.execution.RuntimeEnvironment.(RuntimeEnvironment.java:170) > ... 20 more > {noformat} > > > > -- > This message was sent by Atlassian JIRA > (v6.3.4#6332) > --001a1134dea2c6f88c050f8703e1--