Return-Path: X-Original-To: apmail-samza-dev-archive@minotaur.apache.org Delivered-To: apmail-samza-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B4CA7174E9 for ; Sun, 2 Nov 2014 12:56:53 +0000 (UTC) Received: (qmail 22055 invoked by uid 500); 2 Nov 2014 12:56:53 -0000 Delivered-To: apmail-samza-dev-archive@samza.apache.org Received: (qmail 22006 invoked by uid 500); 2 Nov 2014 12:56:53 -0000 Mailing-List: contact dev-help@samza.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@samza.incubator.apache.org Delivered-To: mailing list dev@samza.incubator.apache.org Received: (qmail 21994 invoked by uid 99); 2 Nov 2014 12:56:53 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 02 Nov 2014 12:56:53 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of renatoj.marroquin@gmail.com designates 209.85.214.175 as permitted sender) Received: from [209.85.214.175] (HELO mail-ob0-f175.google.com) (209.85.214.175) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 02 Nov 2014 12:56:48 +0000 Received: by mail-ob0-f175.google.com with SMTP id gq1so2988845obb.34 for ; Sun, 02 Nov 2014 04:56:28 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=VCKeDMdO4O2SZKvohiUXiseGMBasWBlr/CoPNJKpL4s=; b=WGrEVcVlK3apr0OhHvoPdS2jVjtw5YT0A9wC6iCoLbZBhJ4VIFyp53nEvpv4HoxEj4 NGpzco5NcJFpB+2/Q+Yj+hT1hsg+Tv9n/CWJd7/5sAFs6O0UZ7q7xh5zUpAPJfmbGqAX La2J2j0tUxVP0Vj53hBlnDkYauhM2MHePcimYUS4ztW9CfdBu9cD5+uyEEDDlMFzTrYu mmgqIy6rhS/CesuNItZn6tLrvMYVz7Ttwx7ZVQASQHLPbVi6r59ym/nUe5yYiDFikPY5 tKwbnfVDgBMbpZrR3ceknfcmcBruw9E4iGSvt6pSHKTLuoazOwAjQRvBVd4QiayrFDMn knSg== MIME-Version: 1.0 X-Received: by 10.60.155.34 with SMTP id vt2mr22602015oeb.34.1414932988132; Sun, 02 Nov 2014 04:56:28 -0800 (PST) Received: by 10.76.8.227 with HTTP; Sun, 2 Nov 2014 04:56:28 -0800 (PST) Date: Sun, 2 Nov 2014 13:56:28 +0100 Message-ID: Subject: How to create partitions from input From: =?UTF-8?Q?Renato_Marroqu=C3=ADn_Mogrovejo?= To: dev@samza.incubator.apache.org Content-Type: multipart/alternative; boundary=047d7bd6c5502383060506dfc2c9 X-Virus-Checked: Checked by ClamAV on apache.org --047d7bd6c5502383060506dfc2c9 Content-Type: text/plain; charset=UTF-8 Hello Samza team, I am trying to modify the hello-samza example application to replay events which are in a table. But I am having some troubles. So on the hello-samza example for each new incoming message which belongs to a channel, a new partition is created, right? Now in my case, how (where) do I create these partitions? I create them in [1] but I am almost sure that is wrong because I keep getting the exception saying that there are no partitions for this task. I mean ideally I would like to create partitions based on the keys I am reading from the table. Could anybody help me on this task please? Many thanks in advance! Renato M. Exception in thread "main" org.apache.samza.SamzaException: No partitions for this task. Can't run a task without partition assignments. It's likely that the partition manager for this system doesn't know about the stream you're trying to read. at org.apache.samza.container.SamzaContainer$.main(SamzaContainer.scala:77) at org.apache.samza.container.SamzaContainer.main(SamzaContainer.scala) [1] https://github.com/renato2099/hello-samza/blob/master/samza-wikipedia/src/main/java/samza/examples/order/system/OrderConsumer.java#L47 --047d7bd6c5502383060506dfc2c9--