Mailing-List: contact uima-user-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: uima-user@incubator.apache.org
Received-SPF: pass (nike.apache.org: local policy)
Content-class: urn:content-classes:message
MIME-Version: 1.0
Content-Type: text/plain;
	charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
Subject: RE: RE : UIMA-2.3 : CPE timeout problem with remote processors.
Date: Thu, 1 Apr 2010 08:48:16 +0200
Message-ID: <3D75841CCAED41408E7F85CAA9E9D2930188BAD4@EXV01001.GlobalSP.local>
Thread-Topic: RE : UIMA-2.3 : CPE timeout problem with remote processors.
Thread-Index: AcrQ6UHyL8TEjpjPTwupQeZ6RJK5fQAe0RBQ
References: <n2xfe44bdb91003310845ge57d57f3k85e7e058c13786fa@mail.gmail.com>
From: "Muon Le" <muon.le@temis.com>
To: <uima-user@incubator.apache.org>

My CPE has a collection reader which reads 12 small XCas files (<10Ko) =
in disk and sends to the remote processor SleepBSH which simulates a =
delay processing (more than processor timeout value defined in CPE).
My test aims to see the behavious of the CPE when there are errors =
timeout in remote processors.
So, with small XCas files or Txt files, the CPE detects all timout =
errors provided by the remote processor through Vinci and terminates and =
indicates 12 errors.

But, with 12 bigs XCas files (> 100Ko), the CPE starts to detect timeout =
errors provided by the remote processor and hangs until the remote =
processor was killed.

Thank you for your helps.
Muon.

-----Message d'origine-----
De=A0: Jaroslaw Cwiklik [mailto:uimaee@gmail.com]=20
Envoy=E9=A0: mercredi 31 mars 2010 17:45
=C0=A0: uima-user@incubator.apache.org
Objet=A0: Re: RE : UIMA-2.3 : CPE timeout problem with remote =
processors.

Muon, can you complete analysis of any small documents? Are you getting
client side timeout on ALL of the small docs?

JC

On Wed, Mar 31, 2010 at 11:36 AM, Muon Le <muon.le@temis.com> wrote:

> More accuratly, with small files, there are errors about timeout, but =
the
> CPE terminates properly (without handling).
>
> Muon.
>
>
> -------- Message d'origine--------
> De: Muon Le [mailto:muon.le@temis.com]
> Date: mer. 31/03/2010 16:27
> =C0: uima-user@incubator.apache.org
> Objet : RE: UIMA-2.3 : CPE timeout problem with remote processors.
>
> Hello,
>
> No, with small files, there are no problems.
>
> No. Here is the description file:
>  <?xml version=3D"1.0" encoding=3D"UTF-8" ?>
> - <uriSpecifier xmlns=3D"http://uima.apache.org/resourceSpecifier">
>  <resourceType>AnalysisEngine</resourceType>
>  <uri>com.temis.Default.SleepBSH</uri>
>  <protocol>Vinci</protocol>
>  </uriSpecifier>
>
> Yes, here is a sample of error message in logs:
> WARN  - 2010-03-29 16:09:44,312 - [Procesing Pipeline#4 Thread]:: -
> [MDC:{{docid,
> =
http://www.ardenno.com/pressreleases/news_04sept07.php--Cnt6183}{module,W=
orkflow}{host,racine}{submodule,racine}{workflow,Bug5092}}][THREAD:[Proce=
singPipeline#4
> =
Thread]::][LOGGER:org.apache.uima.collection.impl.cpm.container.deployer.=
VinciTAP][NDC:null]
> java.net.SocketTimeoutException: Read timed out
>        at java.net.SocketInputStream.socketRead0(Native Method)
>        at java.net.SocketInputStream.read(Unknown Source)
>        at java.io.BufferedInputStream.fill(Unknown Source)
>        at java.io.BufferedInputStream.read(Unknown Source)
>        at
> =
org.apache.vinci.transport.XTalkTransporter.fromStream(XTalkTransporter.j=
ava:61)
>        at org.apache.vinci.transport.Frame.fromStream(Frame.java:150)
>        at
> =
org.apache.vinci.transport.BaseClient.sendAndReceiveWork(BaseClient.java:=
650)
>        at
> =
org.apache.vinci.transport.BaseClient.sendAndReceiveWork(BaseClient.java:=
666)
>        at
> =
org.apache.vinci.transport.BaseClient.sendAndReceive(BaseClient.java:383)=

>        at
> =
org.apache.uima.collection.impl.cpm.container.deployer.VinciTAP.sendAndRe=
ceive(VinciTAP.java:453)
>        at
> =
org.apache.uima.collection.impl.cpm.container.deployer.VinciTAP.analyze(V=
inciTAP.java:927)
>        at
> =
org.apache.uima.collection.impl.cpm.container.NetworkCasProcessorImpl.pro=
cess(NetworkCasProcessorImpl.java:198)
>        at
> =
org.apache.uima.collection.impl.cpm.engine.ProcessingUnit.processNext(Pro=
cessingUnit.java:826)
>        at
> =
org.apache.uima.collection.impl.cpm.engine.ProcessingUnit.run(ProcessingU=
nit.java:577)
>
> Thanks for your helps.
> Muon.
>
> -----Message d'origine-----
> De : Jaroslaw Cwiklik [mailto:uimaee@gmail.com]
> Envoy=E9 : mercredi 31 mars 2010 15:39
> =C0 : uima-user@incubator.apache.org
> Objet : Re: UIMA-2.3 : CPE timeout problem with remote processors.
>
> Do you also observe a hang with small files?
> Does client descriptor c:\temp\AnnotClient_Default_SleepBSH.xml name =
the
> same vns host and port that the service is using?
> Any exceptions in logs( service or client side)?
> JC
>
> On Tue, Mar 30, 2010 at 9:21 AM, Muon Le <muon.le@temis.com> wrote:
>
> > Hello,
> >
> >
> >
> > I launch a simple CPE (see bellow) that maintains a remote processor
> > with a timeout defined at 30000ms.
> >
> > The CPE hangs when the processor processes bigs files (10 files > =
100ko)
> > despite the timeout value.
> >
> >
> >
> > Do you have any idea of this problem ?
> >
> >
> >
> > Thanks in advance,
> >
> > Muon.
> >
> > PS. My CPE description :
> >
> >
> >
> > <?xml version=3D"1.0" encoding=3D"UTF-8"?>
> >
> > <cpeDescription xmlns=3D"http://uima.apache.org/resourceSpecifier">
> >
> >    <collectionReader>
> >
> >        <collectionIterator>
> >
> >            <descriptor>
> >
> >                <include
> > =
href=3D"/F:/...../descriptors/collection_readers/XCasCollectionReader.xml=
"
> > />
> >
> >            </descriptor>
> >
> >            <configurationParameterSettings>
> >
> >                <nameValuePair>
> >
> >                    <name>InputDirectory</name>
> >
> >                    <value>
> >
> >                        <string>g:/Luxid/bugs/5092/data/xcas</string>
> >
> >                    </value>
> >
> >                </nameValuePair>
> >
> >            </configurationParameterSettings>
> >
> >        </collectionIterator>
> >
> >    </collectionReader>
> >
> >    <casProcessors casPoolSize=3D"5" processingUnitThreadCount=3D"4">
> >
> >        <casProcessor deployment=3D"remote" name=3D"SleepBSH">
> >
> >            <descriptor>
> >
> >                <include
> > href=3D"c:\temp\AnnotClient_Default_SleepBSH.xml"/>
> >
> >            </descriptor>
> >
> >            <deploymentParameters>
> >
> >                <parameter name=3D"vnsHost" type=3D"string" value=3D" =
???"/>
> >
> >                <parameter name=3D"vnsPort" type=3D"string" =
value=3D"9000"/>
> >
> >                <parameter name=3D"service-access" type=3D"string"
> > value=3D"exclusive"/>
> >
> >            </deploymentParameters>
> >
> >            <errorHandling>
> >
> >                <errorRateThreshold action=3D"continue" =
value=3D"1/1000"/>
> >
> >                <maxConsecutiveRestarts action=3D"continue" =
value=3D"0"/>
> >
> >                <timeout max=3D"30000" default=3D"-1"/>
> >
> >            </errorHandling>
> >
> >            <checkpoint batch=3D"1" time=3D"1000ms"/>
> >
> >        </casProcessor>
> >
> >        <casProcessor deployment=3D"integrated" name=3D"CasConsumer">
> >
> >            <descriptor>
> >
> >                <include
> > =
href=3D"/F:/....../descriptors/cas_consumers/XCasWriterCasConsumer.xml"/>=

> >
> >            </descriptor>
> >
> >            <deploymentParameters/>
> >
> >            <errorHandling>
> >
> >                <errorRateThreshold action=3D"terminate"
> > value=3D"100/1000"/>
> >
> >                <maxConsecutiveRestarts action=3D"terminate" =
value=3D"30"/>
> >
> >                <timeout max=3D"100000" default=3D"-1"/>
> >
> >            </errorHandling>
> >
> >            <checkpoint batch=3D"1" time=3D"1000ms"/>
> >
> >            <configurationParameterSettings>
> >
> >                <nameValuePair>
> >
> >                    <name>OutputDirectory</name>
> >
> >                    <value>
> >
> >                        <string>c:/temp/XCasDirectory</string>
> >
> >                    </value>
> >
> >                </nameValuePair>
> >
> >            </configurationParameterSettings>
> >
> >        </casProcessor>
> >
> >    </casProcessors>
> >
> >    <cpeConfig>
> >
> >        <numToProcess>-1</numToProcess>
> >
> >        <deployAs>immediate</deployAs>
> >
> >        <checkpoint batch=3D"0" time=3D"300000ms"/>
> >
> >        <timerImpl/>
> >
> >    </cpeConfig>
> >
> > </cpeDescription>
> >
> >
>
>