Mailing-List: contact user-help@storm.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@storm.incubator.apache.org
Received-SPF: pass (nike.apache.org: domain of vaillant@animetrics.com
 designates 74.125.149.84 as permitted sender)
Date: Thu, 6 Feb 2014 06:19:19 -0500
From: Marc Vaillant <vaillant@animetrics.com>
To: user@storm.incubator.apache.org
Subject: Re: Can a topology be configured to force a maximum of 1 executor
 per worker?
Message-ID: <20140206111919.GA24383@animetrics.com>
References: <20140205160633.GE2505@animetrics.com>
 <CAGBoazjbiUHMYMqwD6JG2AZZRgNqUGLK7RGnF0iKAiqGHBvWgQ@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: 
 <CAGBoazjbiUHMYMqwD6JG2AZZRgNqUGLK7RGnF0iKAiqGHBvWgQ@mail.gmail.com>
User-Agent: Mutt/1.5.21 (2010-09-15)

Thanks Bijoy,

I will test that. 

Marc

On Wed, Feb 05, 2014 at 09:45:45PM +0530, bijoy deb wrote:
> Hi Marc,
> 
> I believe keeping the total number of executors(i.e. parallelism) across all
> the components(bolts,spouts) to be less than or equal to the total number of
> workers can be one way to achieve this.
> 
> Thanks
> Bijoy
> 
> 
> On Wed, Feb 5, 2014 at 9:36 PM, Marc Vaillant <vaillant@animetrics.com> wrote:
> 
>     Suppose that you have a bolt whose tasks are not thread safe but you
>     still want parallelism.  It seems that this could be achieved via
>     multiprocessing by forcing a maximium of 1 executor per worker.  With
>     this constraint, if you chose a parallelism hint of 4 (with default
>     executors) you would get 4 tasks in 4 executors each running in a
>     separate worker.  Can this constraint be configured?
> 
>     Thanks,
>     Marc
> 
>