Thanks Bijoy,
I will test that.
Marc
On Wed, Feb 05, 2014 at 09:45:45PM +0530, bijoy deb wrote:
> Hi Marc,
>
> I believe keeping the total number of executors(i.e. parallelism) across all
> the components(bolts,spouts) to be less than or equal to the total number of
> workers can be one way to achieve this.
>
> Thanks
> Bijoy
>
>
> On Wed, Feb 5, 2014 at 9:36 PM, Marc Vaillant <vaillant@animetrics.com> wrote:
>
> Suppose that you have a bolt whose tasks are not thread safe but you
> still want parallelism. It seems that this could be achieved via
> multiprocessing by forcing a maximium of 1 executor per worker. With
> this constraint, if you chose a parallelism hint of 4 (with default
> executors) you would get 4 tasks in 4 executors each running in a
> separate worker. Can this constraint be configured?
>
> Thanks,
> Marc
>
>
|