storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Spico Florin <spicoflo...@gmail.com>
Subject Re: localOrShuffleGrouping load balanced tuple distribution
Date Tue, 16 Feb 2016 10:23:17 GMT
Hi, Nathan!
  Thank you for your answer. You are right: the only bolts that are used
will be the ones located nearby the spout. The other two will be unused. If
we increase the  number of workers to 5, then it will behave as
shuffleGrouping (distributing evenly among the bolts).
I got it!
 Regards,
 Florin

On Mon, Feb 15, 2016 at 3:56 PM, Nathan Leung <ncleung@gmail.com> wrote:

> It will use the local bolts.
>
> On Mon, Feb 15, 2016 at 8:32 AM, Spico Florin <spicoflorin@gmail.com>
> wrote:
>
>>
>> Hello!
>>    Suppose that I have the following scenario
>> 1. One spout
>> 2. One bolt with hintParallelism set to 4
>> 3. Bolt connected with the spout with localOrShuffleGrouping
>> 4. 2 slots available
>> 5. We use the the default schedulder (round-robin)
>>
>> Give the above scenario, the distribution over the workers will be:
>> worker 1: spout, bolt, bolt
>> worker 2: bolt, bolt
>>
>> Here are my questions:
>> 1. Will the spout uses the 4 bolts?
>> 2. Will the data distributed evenly between these bolts?
>> 3. Due to localorShuffleGrouping method, only the local bolts will be
>> used (the ones from the worker 1) or all the workers?
>>
>> I look forward for your answers.
>> Thank you.
>>  Florin
>>
>>
>>
>>
>>
>

Mime
View raw message