Return-Path: X-Original-To: apmail-storm-user-archive@minotaur.apache.org Delivered-To: apmail-storm-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9AEBF188D3 for ; Mon, 15 Feb 2016 13:56:30 +0000 (UTC) Received: (qmail 87666 invoked by uid 500); 15 Feb 2016 13:56:29 -0000 Delivered-To: apmail-storm-user-archive@storm.apache.org Received: (qmail 87615 invoked by uid 500); 15 Feb 2016 13:56:29 -0000 Mailing-List: contact user-help@storm.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@storm.apache.org Delivered-To: mailing list user@storm.apache.org Received: (qmail 87605 invoked by uid 99); 15 Feb 2016 13:56:29 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 15 Feb 2016 13:56:29 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 9A412180059 for ; Mon, 15 Feb 2016 13:56:28 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.198 X-Spam-Level: * X-Spam-Status: No, score=1.198 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx2-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id GdvsxINdGWBd for ; Mon, 15 Feb 2016 13:56:27 +0000 (UTC) Received: from mail-io0-f173.google.com (mail-io0-f173.google.com [209.85.223.173]) by mx2-lw-us.apache.org (ASF Mail Server at mx2-lw-us.apache.org) with ESMTPS id BBC5E5FAF9 for ; Mon, 15 Feb 2016 13:56:27 +0000 (UTC) Received: by mail-io0-f173.google.com with SMTP id l127so158486694iof.3 for ; Mon, 15 Feb 2016 05:56:27 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=gSNWUVvi5YolpVsJlbtSKGMvFYQ/X9D14zogpb9FYgc=; b=eXWy4WzitlLSlBYSg1NSdYP0G54q7qT+7D/HuxpXZPG8esTsq6YJgxG3+DKdK2qD9V mYtGRWdnvd9qt+1cLdWEVV0gvQDrtL0rjefzVEEF+pRiWmRb1A3d4FTl078juY/+SApF XPWJih3ZKKXq2CM5EmO341au4QR8pfTD0+wC+U0+P6gzf8Cqo97Gh0VkQTF2XKO9bU08 cAfZX5xKPk47S5h17hZuXh0O8q2yFdVAVahWuiYJ7ffLPlVGAQGMMWpZ5VvanIXHB7/o KuBKGINe6fClFn/NlMSSJ+qLq5tq5ELQ2mTQyxZlfQiJ9FXeO3khZWmGt0RzEByGwGMI IvAg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=gSNWUVvi5YolpVsJlbtSKGMvFYQ/X9D14zogpb9FYgc=; b=LIIEjHO03oN1FTFCUySTnPnoaASnHbyIoMaAU2JnbGBdo85hFFDtj9uEnCVf4yCoZI JhzONN1Uq2lG49wpEViJt6dqvrYNKDs3dnkr9NhkDIxb15MTwwyAg5USmmpqFPYj2Svs OL6py8uh4FLVtf2zKbzx40KLqy31/08k6EyfosPNCNt8SjzXPbHNYMrb+73eqy4wk3Ne ZFmJ/4kMZTXjbTmC9VQgvARbr/I5WkWSYCO5asZ/yGj5dd/8yHW/cqQxW+ITbKTfh/Zb 75kZqObfluD0llqTZAxL9q60mfQ7H/F4QJWyhu2THbts20a27T66+rsaekxZj4Rgygf6 hvgg== X-Gm-Message-State: AG10YOTrnqrUKr4HosH0IY0GvTMVS7l9uSB93bsiQvW7eu07ItZ2zIoIBflhhssUIVc9WR36qc2bnnPKBsKEAA== MIME-Version: 1.0 X-Received: by 10.107.198.14 with SMTP id w14mr17253187iof.83.1455544581595; Mon, 15 Feb 2016 05:56:21 -0800 (PST) Received: by 10.107.183.195 with HTTP; Mon, 15 Feb 2016 05:56:21 -0800 (PST) In-Reply-To: References: Date: Mon, 15 Feb 2016 08:56:21 -0500 Message-ID: Subject: Re: localOrShuffleGrouping load balanced tuple distribution From: Nathan Leung To: user Content-Type: multipart/alternative; boundary=94eb2c049052bdbdc9052bcf612e --94eb2c049052bdbdc9052bcf612e Content-Type: text/plain; charset=UTF-8 It will use the local bolts. On Mon, Feb 15, 2016 at 8:32 AM, Spico Florin wrote: > > Hello! > Suppose that I have the following scenario > 1. One spout > 2. One bolt with hintParallelism set to 4 > 3. Bolt connected with the spout with localOrShuffleGrouping > 4. 2 slots available > 5. We use the the default schedulder (round-robin) > > Give the above scenario, the distribution over the workers will be: > worker 1: spout, bolt, bolt > worker 2: bolt, bolt > > Here are my questions: > 1. Will the spout uses the 4 bolts? > 2. Will the data distributed evenly between these bolts? > 3. Due to localorShuffleGrouping method, only the local bolts will be used > (the ones from the worker 1) or all the workers? > > I look forward for your answers. > Thank you. > Florin > > > > > --94eb2c049052bdbdc9052bcf612e Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
It will use the local bolts.

On Mon, Feb 15, 2016 at 8:32 AM, Spico Fl= orin <spicoflorin@gmail.com> wrote:

Hello!
=C2=A0 =C2=A0Suppos= e that I have the following scenario
1. One spout
2. On= e bolt with hintParallelism set to 4
3. Bolt connected with the s= pout with localOrShuffleGrouping
4. 2 slots available
5= . We use the the default schedulder (round-robin)

= Give the above scenario, the distribution over the workers will be:
worker 1: spout, bolt, bolt
worker 2: bolt, bolt
Here are my questions:
1. Will the spout uses the 4 b= olts?
2. Will the data distributed evenly between these bolts?
3. Due to localorShuffleGrouping method, only the local bolts will = be used (the ones from the worker 1) or all the workers?

I look forward for your answers.
Thank you.
=C2=A0Florin


<= div>


--94eb2c049052bdbdc9052bcf612e--