Return-Path: X-Original-To: apmail-storm-user-archive@minotaur.apache.org Delivered-To: apmail-storm-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6FC5B18209 for ; Tue, 16 Feb 2016 10:23:21 +0000 (UTC) Received: (qmail 26070 invoked by uid 500); 16 Feb 2016 10:23:20 -0000 Delivered-To: apmail-storm-user-archive@storm.apache.org Received: (qmail 26026 invoked by uid 500); 16 Feb 2016 10:23:20 -0000 Mailing-List: contact user-help@storm.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@storm.apache.org Delivered-To: mailing list user@storm.apache.org Received: (qmail 26016 invoked by uid 99); 16 Feb 2016 10:23:19 -0000 Received: from Unknown (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 16 Feb 2016 10:23:19 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 8161CC029B for ; Tue, 16 Feb 2016 10:23:19 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.179 X-Spam-Level: * X-Spam-Status: No, score=1.179 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id t5xsRCbfO_PC for ; Tue, 16 Feb 2016 10:23:18 +0000 (UTC) Received: from mail-lb0-f180.google.com (mail-lb0-f180.google.com [209.85.217.180]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 095895F1B9 for ; Tue, 16 Feb 2016 10:23:18 +0000 (UTC) Received: by mail-lb0-f180.google.com with SMTP id of3so568500lbc.1 for ; Tue, 16 Feb 2016 02:23:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=CUD6R6TkfmWO19F0M4iW4GdvNnoGT+TyEBI9cbscDIg=; b=aYPA8krjXXbQnklGiQlXKiG3XNuFzDvTKxELA6JdSGygBKPMy/w2yEW5pqN1Qa4vru nF2xKpjC3uYJWzO9+jrsPCx7SB53meK8FThRh9lSiv6G+/cR/su9dnizzzEhmRVQ8yvI dYr5a2a78WR5m0uMji2CqdxDlYulPnfa0D8fSJAwIx3P5wSf+kgonbDwvN5poqSbKh2p 81F8rEJRp8EewE5da0tNsft5kit9okzStMAfZYA0c+YkCp+SusVm2IS+LTWBO/om+cNL AKofSoAVgEcLEw0Ape7TiltuV/kYjcxOSE/owy+yjyKt0V3fESqnPzZ19lSJP/tRHddI W2cg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=CUD6R6TkfmWO19F0M4iW4GdvNnoGT+TyEBI9cbscDIg=; b=Pi6y+sjk0GftJ57mopZd+J1TqSdVjEtqbV37PcYKAxx5miizFATSP4nlJB0GR6ueKp XiO+foPVCgQxhQjSZ6clflkXrDdWo6f0/6AvxG9mfMMRFyT+jpwki2tIk9/QZnGf5lqy ksnDWI3IjCaJXkOHce2U+5kIs45hZVp2/+qruBxryWA8lbLLydbyIt5ETA8sTLy00+hD 5nHm6euFClEawJ8Bcz34gs8KdzrTlz3DAHJj/ryHNzZ+GtZCxrM7gsYqGmpRpGCl/B81 mNkdekaXZvWiWBqJZSulSvEcmf5b/Tq8LwcnwKC1lzv0nP+EQKAIn5DDgrKcD/7FxyJw uyzQ== X-Gm-Message-State: AG10YOSZZrktI4GFQZezJoqTH3vf1bMGXB6Rs/07GAdQ0Um4d3H5pAEjQyH/x6TzLZpQDoEv70ATUQhDjf//Iw== MIME-Version: 1.0 X-Received: by 10.112.140.169 with SMTP id rh9mr7882916lbb.69.1455618197512; Tue, 16 Feb 2016 02:23:17 -0800 (PST) Received: by 10.25.21.163 with HTTP; Tue, 16 Feb 2016 02:23:17 -0800 (PST) In-Reply-To: References: Date: Tue, 16 Feb 2016 12:23:17 +0200 Message-ID: Subject: Re: localOrShuffleGrouping load balanced tuple distribution From: Spico Florin To: user@storm.apache.org Content-Type: multipart/alternative; boundary=001a11c2593497691d052be085e9 --001a11c2593497691d052be085e9 Content-Type: text/plain; charset=UTF-8 Hi, Nathan! Thank you for your answer. You are right: the only bolts that are used will be the ones located nearby the spout. The other two will be unused. If we increase the number of workers to 5, then it will behave as shuffleGrouping (distributing evenly among the bolts). I got it! Regards, Florin On Mon, Feb 15, 2016 at 3:56 PM, Nathan Leung wrote: > It will use the local bolts. > > On Mon, Feb 15, 2016 at 8:32 AM, Spico Florin > wrote: > >> >> Hello! >> Suppose that I have the following scenario >> 1. One spout >> 2. One bolt with hintParallelism set to 4 >> 3. Bolt connected with the spout with localOrShuffleGrouping >> 4. 2 slots available >> 5. We use the the default schedulder (round-robin) >> >> Give the above scenario, the distribution over the workers will be: >> worker 1: spout, bolt, bolt >> worker 2: bolt, bolt >> >> Here are my questions: >> 1. Will the spout uses the 4 bolts? >> 2. Will the data distributed evenly between these bolts? >> 3. Due to localorShuffleGrouping method, only the local bolts will be >> used (the ones from the worker 1) or all the workers? >> >> I look forward for your answers. >> Thank you. >> Florin >> >> >> >> >> > --001a11c2593497691d052be085e9 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi, Nathan!
=C2=A0 Thank you for your answer. You are = right: the only bolts that are used will be the ones located nearby the spo= ut. The other two will be unused. If we increase the =C2=A0number of worker= s to 5, then it will behave as shuffleGrouping (distributing evenly among t= he bolts).=C2=A0
I got it!
=C2=A0Regards,
=C2= =A0Florin

On Mon, Feb 15, 2016 at 3:56 PM, Nathan Leung <ncleung@gmail.com&g= t; wrote:
It will= use the local bolts.

On Mon, Feb 15, 2016 at 8= :32 AM, Spico Florin <spicoflorin@gmail.com> wrote:
<= blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px= #ccc solid;padding-left:1ex">

Hello!
=C2=A0 =C2=A0Suppose that I have t= he following scenario
1. One spout
2. One bolt with hin= tParallelism set to 4
3. Bolt connected with the spout with local= OrShuffleGrouping
4. 2 slots available
5. We use the th= e default schedulder (round-robin)

Give the above = scenario, the distribution over the workers will be:
worker 1: sp= out, bolt, bolt
worker 2: bolt, bolt

Her= e are my questions:
1. Will the spout uses the 4 bolts?
2. Will the data distributed evenly between these bolts?
3. Due = to localorShuffleGrouping method, only the local bolts will be used (the on= es from the worker 1) or all the workers?

I look f= orward for your answers.
Thank you.
=C2=A0Florin



<= /font>



--001a11c2593497691d052be085e9--