Return-Path: 
 <uima-user-return-415-apmail-incubator-uima-user-archive=incubator.apache.org@incubator.apache.org>
Delivered-To: apmail-incubator-uima-user-archive@locus.apache.org
Received: (qmail 41575 invoked from network); 18 Jul 2007 08:12:14 -0000
Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2)
  by minotaur.apache.org with SMTP; 18 Jul 2007 08:12:14 -0000
Received: (qmail 14694 invoked by uid 500); 18 Jul 2007 08:11:48 -0000
Delivered-To: apmail-incubator-uima-user-archive@incubator.apache.org
Received: (qmail 14619 invoked by uid 500); 18 Jul 2007 08:11:48 -0000
Mailing-List: contact uima-user-help@incubator.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:uima-user-help@incubator.apache.org>
List-Unsubscribe: <mailto:uima-user-unsubscribe@incubator.apache.org>
List-Post: <mailto:uima-user@incubator.apache.org>
List-Id: <uima-user.incubator.apache.org>
Reply-To: uima-user@incubator.apache.org
Delivered-To: mailing list uima-user@incubator.apache.org
Received: (qmail 14578 invoked by uid 99); 18 Jul 2007 08:11:48 -0000
Received: from herse.apache.org (HELO herse.apache.org) (140.211.11.133)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Jul 2007 01:11:48 -0700
X-ASF-Spam-Status: No, hits=-0.0 required=10.0
	tests=SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (herse.apache.org: domain of benjams@il.ibm.com designates
 195.212.29.150 as permitted sender)
Received: from [195.212.29.150] (HELO mtagate1.de.ibm.com) (195.212.29.150)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Jul 2007 01:11:44 -0700
Received: from d12nrmr1607.megacenter.de.ibm.com
 (d12nrmr1607.megacenter.de.ibm.com [9.149.167.49])
	by mtagate1.de.ibm.com (8.13.8/8.13.8) with ESMTP id l6I8BMI6073480
	for <uima-user@incubator.apache.org>; Wed, 18 Jul 2007 08:11:22 GMT
Received: from d12av04.megacenter.de.ibm.com (d12av04.megacenter.de.ibm.com
 [9.149.165.229])
	by d12nrmr1607.megacenter.de.ibm.com (8.13.8/8.13.8/NCO v8.4) with ESMTP id
 l6I8B9nX1974462
	for <uima-user@incubator.apache.org>; Wed, 18 Jul 2007 10:11:22 +0200
Received: from d12av04.megacenter.de.ibm.com (loopback [127.0.0.1])
	by d12av04.megacenter.de.ibm.com (8.12.11.20060308/8.13.3) with ESMTP id
 l6I8ArEK017333
	for <uima-user@incubator.apache.org>; Wed, 18 Jul 2007 10:10:53 +0200
Received: from d12mc102.megacenter.de.ibm.com (d12mc102.megacenter.de.ibm.com
 [9.149.167.114])
	by d12av04.megacenter.de.ibm.com (8.12.11.20060308/8.12.11) with ESMTP id
 l6I8AqtJ016702
	for <uima-user@incubator.apache.org>; Wed, 18 Jul 2007 10:10:52 +0200
In-Reply-To: <cd6edfd30707171324k3a816e09xecf86b522f950ada@mail.gmail.com>
Subject: Re: Multi-threading with a CAS Multiplier.
To: uima-user@incubator.apache.org
X-Mailer: Lotus Notes Release 7.0 HF277 June 21, 2006
Message-ID: 
 <OF72500FC9.C4FAA9EC-ONC225731C.00217B93-C225731C.002CC0D5@il.ibm.com>
From: Benjamin Sznajder <benjams@il.ibm.com>
Date: Wed, 18 Jul 2007 11:08:49 +0300
X-MIMETrack: Serialize by Router on D12MC102/12/M/IBM(Release 7.0.2HF71 |
 November 3, 2006) at
 18/07/2007 11:10:51
MIME-Version: 1.0
Content-type: text/plain; charset=US-ASCII
X-Virus-Checked: Checked by ClamAV on apache.org

Hi Eddie,

Thank you for your so rapid answer.

Indeed, my CASMultiplier is hidden in an Aggregated Engine  named AE1.
This AE1 contains
      - a CASMultiplier
      - a second AggregateEngine2 controlled by a FlowController composed
of different pipelines.
      - a CAS Merger
      - a CAS Consumer


The whole CPM is composed by a CollectionReader, and the AE1

If I define the AggregateEngine2 (i.e the AE that does not contain the
CASMultiplier) with multipleDeploymentAllowed=true, with each Analysis
Engine in it, defined also with multipleDeploymentAllowed=true (including
the FlowController)
And if, in addition, I set <casProcessors casPoolSize="5"
processingUnitThreadCount="3">

In such configuration, do I run in parallel on the pipelines contained in
AggregateEngine2?

Thanks
Benjamin.



                                                                           
             "Eddie Epstein"                                               
             <eaepstein@gmail.                                             
             com>                                                       To 
                                       uima-user@incubator.apache.org      
             17/07/2007 23:24                                           cc 
                                                                           
                                                                   Subject 
             Please respond to         Re: Multi-threading with a CAS      
             uima-user@incubat         Multiplier.                         
               or.apache.org                                               
                                                                           
                                                                           
                                                                           
                                                                           
                                                                           




Hi Benjamin,

The basic UIMA aggregate analysis engine is single threaded, resulting
in the behavior you describe. Multi-threading must be provided by a layer
above a UIMA analysis engine, for example, the CPM.

The parameter multipleDeploymentAllowed is used by the CPM;
when multiple parallel processing pipelines are specified, any components
with multipleDeploymentAllowed=false will not be replicated.

The CPM only supports a single type of Cas multiplier: the collection
reader.
The CPM does not understand Cas multipliers; such components can exist
within an aggregate AE but only the same Cas sent in to an AE from the CPM
can come out of the AE.

Eddie


On 7/17/07, Benjamin Sznajder <benjams@il.ibm.com> wrote:
>
> Hello,
>
> I built a CPE including a CAS Multiplier with two pipelines of AE:
>
> A CAS enters the CAS Multiplier and is splitted to two different CASes
> that, according to their type, are directed to one or the other pipeline.
> Currently, one CAS enters the CAS Multiplier, and then one CAS exits the
> CAS Mult and passes the whole relevant pipeline, before the second CAS
> Multiplier is outputted by the CAS Multiplier and psases the second
> pipeline.
>
> I would be interested by parallelism :
> I mean that I would like that when the first CAS outputted by the CAS
> Multiplier is passing through its relevant pipeline, the second CAS
passes
> in parallel by its second relevant pipeline.
>
> Is the section 3.7 in the Developper's guide the answer to my question?
> Is there any connection (if yes, which one?) with the parameter:
> multipleDeploymentAllowed
>
> Regards,
>
> Benjamin
>
>