uima-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Muon Le" <muon...@temis.com>
Subject RE: RE : UIMA-2.3 : CPE timeout problem with remote processors.
Date Thu, 01 Apr 2010 06:48:16 GMT
My CPE has a collection reader which reads 12 small XCas files (<10Ko) in disk and sends
to the remote processor SleepBSH which simulates a delay processing (more than processor timeout
value defined in CPE).
My test aims to see the behavious of the CPE when there are errors timeout in remote processors.
So, with small XCas files or Txt files, the CPE detects all timout errors provided by the
remote processor through Vinci and terminates and indicates 12 errors.

But, with 12 bigs XCas files (> 100Ko), the CPE starts to detect timeout errors provided
by the remote processor and hangs until the remote processor was killed.

Thank you for your helps.
Muon.

-----Message d'origine-----
De : Jaroslaw Cwiklik [mailto:uimaee@gmail.com] 
Envoyé : mercredi 31 mars 2010 17:45
À : uima-user@incubator.apache.org
Objet : Re: RE : UIMA-2.3 : CPE timeout problem with remote processors.

Muon, can you complete analysis of any small documents? Are you getting
client side timeout on ALL of the small docs?

JC

On Wed, Mar 31, 2010 at 11:36 AM, Muon Le <muon.le@temis.com> wrote:

> More accuratly, with small files, there are errors about timeout, but the
> CPE terminates properly (without handling).
>
> Muon.
>
>
> -------- Message d'origine--------
> De: Muon Le [mailto:muon.le@temis.com]
> Date: mer. 31/03/2010 16:27
> À: uima-user@incubator.apache.org
> Objet : RE: UIMA-2.3 : CPE timeout problem with remote processors.
>
> Hello,
>
> No, with small files, there are no problems.
>
> No. Here is the description file:
>  <?xml version="1.0" encoding="UTF-8" ?>
> - <uriSpecifier xmlns="http://uima.apache.org/resourceSpecifier">
>  <resourceType>AnalysisEngine</resourceType>
>  <uri>com.temis.Default.SleepBSH</uri>
>  <protocol>Vinci</protocol>
>  </uriSpecifier>
>
> Yes, here is a sample of error message in logs:
> WARN  - 2010-03-29 16:09:44,312 - [Procesing Pipeline#4 Thread]:: -
> [MDC:{{docid,
> http://www.ardenno.com/pressreleases/news_04sept07.php--Cnt6183}{module,Workflow}{host,racine}{submodule,racine}{workflow,Bug5092}}][THREAD:[ProcesingPipeline#4
> Thread]::][LOGGER:org.apache.uima.collection.impl.cpm.container.deployer.VinciTAP][NDC:null]
> java.net.SocketTimeoutException: Read timed out
>        at java.net.SocketInputStream.socketRead0(Native Method)
>        at java.net.SocketInputStream.read(Unknown Source)
>        at java.io.BufferedInputStream.fill(Unknown Source)
>        at java.io.BufferedInputStream.read(Unknown Source)
>        at
> org.apache.vinci.transport.XTalkTransporter.fromStream(XTalkTransporter.java:61)
>        at org.apache.vinci.transport.Frame.fromStream(Frame.java:150)
>        at
> org.apache.vinci.transport.BaseClient.sendAndReceiveWork(BaseClient.java:650)
>        at
> org.apache.vinci.transport.BaseClient.sendAndReceiveWork(BaseClient.java:666)
>        at
> org.apache.vinci.transport.BaseClient.sendAndReceive(BaseClient.java:383)
>        at
> org.apache.uima.collection.impl.cpm.container.deployer.VinciTAP.sendAndReceive(VinciTAP.java:453)
>        at
> org.apache.uima.collection.impl.cpm.container.deployer.VinciTAP.analyze(VinciTAP.java:927)
>        at
> org.apache.uima.collection.impl.cpm.container.NetworkCasProcessorImpl.process(NetworkCasProcessorImpl.java:198)
>        at
> org.apache.uima.collection.impl.cpm.engine.ProcessingUnit.processNext(ProcessingUnit.java:826)
>        at
> org.apache.uima.collection.impl.cpm.engine.ProcessingUnit.run(ProcessingUnit.java:577)
>
> Thanks for your helps.
> Muon.
>
> -----Message d'origine-----
> De : Jaroslaw Cwiklik [mailto:uimaee@gmail.com]
> Envoyé : mercredi 31 mars 2010 15:39
> À : uima-user@incubator.apache.org
> Objet : Re: UIMA-2.3 : CPE timeout problem with remote processors.
>
> Do you also observe a hang with small files?
> Does client descriptor c:\temp\AnnotClient_Default_SleepBSH.xml name the
> same vns host and port that the service is using?
> Any exceptions in logs( service or client side)?
> JC
>
> On Tue, Mar 30, 2010 at 9:21 AM, Muon Le <muon.le@temis.com> wrote:
>
> > Hello,
> >
> >
> >
> > I launch a simple CPE (see bellow) that maintains a remote processor
> > with a timeout defined at 30000ms.
> >
> > The CPE hangs when the processor processes bigs files (10 files > 100ko)
> > despite the timeout value.
> >
> >
> >
> > Do you have any idea of this problem ?
> >
> >
> >
> > Thanks in advance,
> >
> > Muon.
> >
> > PS. My CPE description :
> >
> >
> >
> > <?xml version="1.0" encoding="UTF-8"?>
> >
> > <cpeDescription xmlns="http://uima.apache.org/resourceSpecifier">
> >
> >    <collectionReader>
> >
> >        <collectionIterator>
> >
> >            <descriptor>
> >
> >                <include
> > href="/F:/...../descriptors/collection_readers/XCasCollectionReader.xml"
> > />
> >
> >            </descriptor>
> >
> >            <configurationParameterSettings>
> >
> >                <nameValuePair>
> >
> >                    <name>InputDirectory</name>
> >
> >                    <value>
> >
> >                        <string>g:/Luxid/bugs/5092/data/xcas</string>
> >
> >                    </value>
> >
> >                </nameValuePair>
> >
> >            </configurationParameterSettings>
> >
> >        </collectionIterator>
> >
> >    </collectionReader>
> >
> >    <casProcessors casPoolSize="5" processingUnitThreadCount="4">
> >
> >        <casProcessor deployment="remote" name="SleepBSH">
> >
> >            <descriptor>
> >
> >                <include
> > href="c:\temp\AnnotClient_Default_SleepBSH.xml"/>
> >
> >            </descriptor>
> >
> >            <deploymentParameters>
> >
> >                <parameter name="vnsHost" type="string" value=" ???"/>
> >
> >                <parameter name="vnsPort" type="string" value="9000"/>
> >
> >                <parameter name="service-access" type="string"
> > value="exclusive"/>
> >
> >            </deploymentParameters>
> >
> >            <errorHandling>
> >
> >                <errorRateThreshold action="continue" value="1/1000"/>
> >
> >                <maxConsecutiveRestarts action="continue" value="0"/>
> >
> >                <timeout max="30000" default="-1"/>
> >
> >            </errorHandling>
> >
> >            <checkpoint batch="1" time="1000ms"/>
> >
> >        </casProcessor>
> >
> >        <casProcessor deployment="integrated" name="CasConsumer">
> >
> >            <descriptor>
> >
> >                <include
> > href="/F:/....../descriptors/cas_consumers/XCasWriterCasConsumer.xml"/>
> >
> >            </descriptor>
> >
> >            <deploymentParameters/>
> >
> >            <errorHandling>
> >
> >                <errorRateThreshold action="terminate"
> > value="100/1000"/>
> >
> >                <maxConsecutiveRestarts action="terminate" value="30"/>
> >
> >                <timeout max="100000" default="-1"/>
> >
> >            </errorHandling>
> >
> >            <checkpoint batch="1" time="1000ms"/>
> >
> >            <configurationParameterSettings>
> >
> >                <nameValuePair>
> >
> >                    <name>OutputDirectory</name>
> >
> >                    <value>
> >
> >                        <string>c:/temp/XCasDirectory</string>
> >
> >                    </value>
> >
> >                </nameValuePair>
> >
> >            </configurationParameterSettings>
> >
> >        </casProcessor>
> >
> >    </casProcessors>
> >
> >    <cpeConfig>
> >
> >        <numToProcess>-1</numToProcess>
> >
> >        <deployAs>immediate</deployAs>
> >
> >        <checkpoint batch="0" time="300000ms"/>
> >
> >        <timerImpl/>
> >
> >    </cpeConfig>
> >
> > </cpeDescription>
> >
> >
>
>

Mime
View raw message