Return-Path: 
 <user-return-5259-apmail-uima-user-archive=uima.apache.org@uima.apache.org>
X-Original-To: apmail-uima-user-archive@www.apache.org
Delivered-To: apmail-uima-user-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 1A4A810114
	for <apmail-uima-user-archive@www.apache.org>;
 Wed,  7 Aug 2013 18:47:52 +0000 (UTC)
Received: (qmail 82634 invoked by uid 500); 7 Aug 2013 18:47:51 -0000
Delivered-To: apmail-uima-user-archive@uima.apache.org
Received: (qmail 82562 invoked by uid 500); 7 Aug 2013 18:47:51 -0000
Mailing-List: contact user-help@uima.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@uima.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@uima.apache.org>
List-Post: <mailto:user@uima.apache.org>
List-Id: <user.uima.apache.org>
Reply-To: user@uima.apache.org
Delivered-To: mailing list user@uima.apache.org
Received: (qmail 82532 invoked by uid 99); 7 Aug 2013 18:47:51 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 07 Aug 2013 18:47:51 +0000
X-ASF-Spam-Status: No, hits=-2.3 required=5.0
	tests=RCVD_IN_DNSWL_MED,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: local policy)
Received: from [155.97.131.100] (HELO ipo4hsc.utah.edu) (155.97.131.100)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 07 Aug 2013 18:47:44 +0000
X-SBRS: None
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: 
 AqAEALiVAlKbYbVm/2dsb2JhbABbgztQvkeBM3SCK4ELAQhlAhElAgQTh34DDwyYG5dVDVeIB40qgj06hA4DjjuHPYFpgSqKfoUngxeCKg
X-IPAS-Result: 
 AqAEALiVAlKbYbVm/2dsb2JhbABbgztQvkeBM3SCK4ELAQhlAhElAgQTh34DDwyYG5dVDVeIB40qgj06hA4DjjuHPYFpgSqKfoUngxeCKg
X-IronPort-AV: E=Sophos;i="4.89,834,1367992800";
   d="scan'208";a="234449308"
Received: from h102.umail.utah.edu (HELO X-HUB2.xds.umail.utah.edu)
 ([155.97.181.102])
  by ipo4smtp.cc.utah.edu with ESMTP/TLS/AES128-SHA;
 07 Aug 2013 12:47:21 -0600
Received: from X-MB10.xds.umail.utah.edu ([169.254.14.90]) by
 X-HUB2.xds.umail.utah.edu ([155.97.181.102]) with mapi id 14.03.0123.003;
 Wed, 7 Aug 2013 12:47:21 -0600
From: "RYAN C. CORNIA" <ryan.cornia@utah.edu>
To: "user@uima.apache.org" <user@uima.apache.org>
Subject: Re: UIMA AS Asynchronous = true not behaving as expected.
Thread-Topic: UIMA AS Asynchronous = true not behaving as expected.
Thread-Index: AQHOk4tukpx9QNZv40mGUa70GoCl5ZmKb7UA//+mSIA=
Date: Wed, 7 Aug 2013 18:47:20 +0000
Message-ID: <CE27F15D.5892%ryan.cornia@utah.edu>
In-Reply-To: 
 <CAGRYgEMctg3JwWvKUHcCCHkuQaLTEVmnYhphmX9C2kOGbZZj1g@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
user-agent: Microsoft-MacOutlook/14.3.6.130613
x-originating-ip: [71.199.52.170]
Content-Type: text/plain; charset="Windows-1252"
Content-ID: <ACA71D625BA42446B741380128E8B920@umail.utah.edu>
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-Virus-Checked: Checked by ClamAV on apache.org

I removed:

<analysisEngine async=3D"true">
                <scaleout numberOfInstances=3D"1"/> <=3D=3D at the top leve=
l
analysis Engine removed.

>From the deployment descriptor, but with the same results. (There was not
a warning before.)

I am calling the engine programmatically:

mUAEngine.setCollectionReader(collectionReader);
		mUAEngine.initialize(mAppCtx);
	=09
		log.info("SerializationStrategy: " +
mUAEngine.getSerializationStrategy());
	=09
		/**
		 * Catch exceptions that are thrown during processing, output the
exception to the log,
		 * then make sure the engine is stopped.
		 */
		try {
			mUAEngine.process();
=8A
}

Scaling via async=3Dfalse and the number of instances =3D 6 DOES speed the
pipeline up by 6x, so I think the client is working correctly. It seems to
just be an issue when the async=3Dtrue. I checked in the JMX console with
async=3Dtrue and slow annotator =3D 6 instances and inside JMX UIMA reports
there are 6 instances of slow annotator configured. So it appears the
configuration is getting set right inside of UIMA.

Other thoughts?
Ryan



	=09




On 8/7/13 12:08 PM, "Eddie Epstein" <eaepstein@gmail.com> wrote:

>What client program are you using to drive the uima-as service? Anything
>using sendAndReceiveCAS will only send one at a time.
>
>Please use the runRemoteAsyncAE.sh program and specify the number of
>outstanding CASes with -p. With no specification the number is 2.
>
>Eddie
>
>
>On Wed, Aug 7, 2013 at 12:30 PM, RYAN C. CORNIA
><ryan.cornia@utah.edu>wrote:
>
>> I'm using UIMA AS 2.4.0, and have an example pipeline with 3 annotators.
>> The third annotator is coded to just sleep for 3 seconds per document to
>> simulate a slow annotator.
>>
>> If I change the pipeline to async=3Dtrue and set the number of scale out
>> instances on the slow annotator to be 6, I expected the pipeline to be
>> about 6 times faster. What I see, however, is exactly the same
>>performance.
>>
>> A bit of debugging shows UIMA AS is creating 6 different copies of the
>> slow annotator, because each one is being called alternately per CAS,
>>but
>> it is waiting for the entire pipeline to be complete before getting
>>another
>> cas off the queue.
>>
>> Any ideas what may be misconfigured? Or what to look at?
>>
>> My deployment descriptor is:
>>
>> <?xml version=3D"1.0" encoding=3D"UTF-8"?>
>> <analysisEngineDeploymentDescription xmlns=3D"
>> http://uima.apache.org/resourceSpecifier">
>>     <name>defaultFlapDeployDescriptor20130807.095936</name>
>>     <description/>
>>     <version>1.0</version>
>>     <vendor/>
>>     <deployment protocol=3D"jms" provider=3D"activemq">
>>         <casPool numberOfCASes=3D"6" initialFsHeapSize=3D"2000000"/>
>>         <service>
>>             <inputQueue endpoint=3D"exampleQueue"
>> brokerURL=3D"tcp://localhost:61616" prefetch=3D"0"/>
>>             <topDescriptor>
>>                 <import
>>=20
>>location=3D"file:/var/folders/vl/7p2qch6j4kx_kv5chvd093l80000gn/T/flapAgg=
re
>>gate311122232121092424.xml"/>
>>             </topDescriptor>
>>             <analysisEngine async=3D"true">
>>                 <scaleout numberOfInstances=3D"1"/>
>>                 <delegates>
>>                     <analysisEngine
>>=20
>>key=3D"aeWhitespaceTokenizerDescriptor211289c8cf04-b67c-45e2-a1eb-e90a85f=
39
>>006"
>> async=3D"false">
>>                         <scaleout numberOfInstances=3D"1"/>
>>                         <asyncAggregateErrorConfiguration>
>>                             <getMetadataErrors maxRetries=3D"0"
>>timeout=3D"0"
>> errorAction=3D"terminate"/>
>>                             <processCasErrors thresholdCount=3D"0"
>> thresholdWindow=3D"0" thresholdAction=3D"terminate"/>
>>                             <collectionProcessCompleteErrors timeout=3D"=
0"
>> additionalErrorAction=3D"terminate"/>
>>                         </asyncAggregateErrorConfiguration>
>>                     </analysisEngine>
>>                     <analysisEngine
>> key=3D"aeWordTokenizerDescriptor21126d2902a3-e6ca-4834-89cb-ec1a6c29f281=
"
>> async=3D"false">
>>                         <scaleout numberOfInstances=3D"1"/>
>>                         <asyncAggregateErrorConfiguration>
>>                             <getMetadataErrors maxRetries=3D"0"
>>timeout=3D"0"
>> errorAction=3D"terminate"/>
>>                             <processCasErrors thresholdCount=3D"0"
>> thresholdWindow=3D"0" thresholdAction=3D"terminate"/>
>>                             <collectionProcessCompleteErrors timeout=3D"=
0"
>> additionalErrorAction=3D"terminate"/>
>>                         </asyncAggregateErrorConfiguration>
>>                     </analysisEngine>
>>                     <analysisEngine
>>=20
>>key=3D"gov.va.vinci.flap.examples.ae.MySlowAnnotator2112fc3e83f1-f535-40c=
2-
>>a860-895207bfff1a"
>> async=3D"false">
>>                         <scaleout numberOfInstances=3D"6"/>
>>                         <asyncAggregateErrorConfiguration>
>>                             <getMetadataErrors maxRetries=3D"0"
>>timeout=3D"0"
>> errorAction=3D"terminate"/>
>>                             <processCasErrors thresholdCount=3D"0"
>> thresholdWindow=3D"0" thresholdAction=3D"terminate"/>
>>                             <collectionProcessCompleteErrors timeout=3D"=
0"
>> additionalErrorAction=3D"terminate"/>
>>                         </asyncAggregateErrorConfiguration>
>>                     </analysisEngine>
>>                 </delegates>
>>                 <asyncPrimitiveErrorConfiguration>
>>                     <processCasErrors thresholdCount=3D"0"
>> thresholdWindow=3D"0" thresholdAction=3D"terminate"/>
>>                     <collectionProcessCompleteErrors timeout=3D"0"
>> additionalErrorAction=3D"terminate"/>
>>                 </asyncPrimitiveErrorConfiguration>
>>             </analysisEngine>
>>         </service>
>>     </deployment>
>> </analysisEngineDeploymentDescription>
>>
>> Thanks!
>> Ryan
>>
>>
>>