uima-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Muon Le" <muon...@temis.com>
Subject RE: UIMA-2.3 : CPE timeout problem with remote processors.
Date Thu, 01 Apr 2010 07:05:36 GMT
I did more tests about bigs XCas files (>100Ko).
When I start my CPE with only one big XCas file, the CPE terminates properly with one timout
error.
Howerver, when I continue to start the same CPE with an other big XCas file, the CPE detects
the timeout error and hangs.

Thanks,
Muon.

-----Message d'origine-----
De : Jaroslaw Cwiklik [mailto:uimaee@gmail.com] 
Envoyé : mercredi 31 mars 2010 18:12
À : uima-user@incubator.apache.org
Objet : Re: UIMA-2.3 : CPE timeout problem with remote processors.

Hmm, your  previous description confused me:

"More accuratly, with small files, there are errors about timeout, but the
CPE terminates properly (without handling)."

So you are not seeing any problems while processing small files. Its the big
files that cause the timeout. Looking at
the stack trace it seems like this is a problem in the Vinci
Serializer/Deserializer. Not sure if this a problem with
sending or receiving. Is your service receiving and processing a large CAS
(file)? How large is the file?

JC

On Wed, Mar 31, 2010 at 10:27 AM, Muon Le <muon.le@temis.com> wrote:

> Hello,
>
> No, with small files, there are no problems.
>
> No. Here is the description file:
>   <?xml version="1.0" encoding="UTF-8" ?>
> - <uriSpecifier xmlns="http://uima.apache.org/resourceSpecifier">
>  <resourceType>AnalysisEngine</resourceType>
>  <uri>com.temis.Default.SleepBSH</uri>
>  <protocol>Vinci</protocol>
>  </uriSpecifier>
>
> Yes, here is a sample of error message in logs:
> WARN  - 2010-03-29 16:09:44,312 - [Procesing Pipeline#4 Thread]:: -
> [MDC:{{docid,
> http://www.ardenno.com/pressreleases/news_04sept07.php--Cnt6183}{module,Workflow}{host,racine}{submodule,racine}{workflow,Bug5092}}][THREAD:[ProcesingPipeline#4
> Thread]::][LOGGER:org.apache.uima.collection.impl.cpm.container.deployer.VinciTAP][NDC:null]
> java.net.SocketTimeoutException: Read timed out
>        at java.net.SocketInputStream.socketRead0(Native Method)
>        at java.net.SocketInputStream.read(Unknown Source)
>        at java.io.BufferedInputStream.fill(Unknown Source)
>        at java.io.BufferedInputStream.read(Unknown Source)
>        at
> org.apache.vinci.transport.XTalkTransporter.fromStream(XTalkTransporter.java:61)
>        at org.apache.vinci.transport.Frame.fromStream(Frame.java:150)
>        at
> org.apache.vinci.transport.BaseClient.sendAndReceiveWork(BaseClient.java:650)
>        at
> org.apache.vinci.transport.BaseClient.sendAndReceiveWork(BaseClient.java:666)
>        at
> org.apache.vinci.transport.BaseClient.sendAndReceive(BaseClient.java:383)
>        at
> org.apache.uima.collection.impl.cpm.container.deployer.VinciTAP.sendAndReceive(VinciTAP.java:453)
>        at
> org.apache.uima.collection.impl.cpm.container.deployer.VinciTAP.analyze(VinciTAP.java:927)
>        at
> org.apache.uima.collection.impl.cpm.container.NetworkCasProcessorImpl.process(NetworkCasProcessorImpl.java:198)
>        at
> org.apache.uima.collection.impl.cpm.engine.ProcessingUnit.processNext(ProcessingUnit.java:826)
>        at
> org.apache.uima.collection.impl.cpm.engine.ProcessingUnit.run(ProcessingUnit.java:577)
>
> Thanks for your helps.
> Muon.
>
> -----Message d'origine-----
> De : Jaroslaw Cwiklik [mailto:uimaee@gmail.com]
> Envoyé : mercredi 31 mars 2010 15:39
> À : uima-user@incubator.apache.org
> Objet : Re: UIMA-2.3 : CPE timeout problem with remote processors.
>
> Do you also observe a hang with small files?
> Does client descriptor c:\temp\AnnotClient_Default_SleepBSH.xml name the
> same vns host and port that the service is using?
> Any exceptions in logs( service or client side)?
> JC
>
> On Tue, Mar 30, 2010 at 9:21 AM, Muon Le <muon.le@temis.com> wrote:
>
> > Hello,
> >
> >
> >
> > I launch a simple CPE (see bellow) that maintains a remote processor
> > with a timeout defined at 30000ms.
> >
> > The CPE hangs when the processor processes bigs files (10 files > 100ko)
> > despite the timeout value.
> >
> >
> >
> > Do you have any idea of this problem ?
> >
> >
> >
> > Thanks in advance,
> >
> > Muon.
> >
> > PS. My CPE description :
> >
> >
> >
> > <?xml version="1.0" encoding="UTF-8"?>
> >
> > <cpeDescription xmlns="http://uima.apache.org/resourceSpecifier">
> >
> >    <collectionReader>
> >
> >        <collectionIterator>
> >
> >            <descriptor>
> >
> >                <include
> > href="/F:/...../descriptors/collection_readers/XCasCollectionReader.xml"
> > />
> >
> >            </descriptor>
> >
> >            <configurationParameterSettings>
> >
> >                <nameValuePair>
> >
> >                    <name>InputDirectory</name>
> >
> >                    <value>
> >
> >                        <string>g:/Luxid/bugs/5092/data/xcas</string>
> >
> >                    </value>
> >
> >                </nameValuePair>
> >
> >            </configurationParameterSettings>
> >
> >        </collectionIterator>
> >
> >    </collectionReader>
> >
> >    <casProcessors casPoolSize="5" processingUnitThreadCount="4">
> >
> >        <casProcessor deployment="remote" name="SleepBSH">
> >
> >            <descriptor>
> >
> >                <include
> > href="c:\temp\AnnotClient_Default_SleepBSH.xml"/>
> >
> >            </descriptor>
> >
> >            <deploymentParameters>
> >
> >                <parameter name="vnsHost" type="string" value=" ???"/>
> >
> >                <parameter name="vnsPort" type="string" value="9000"/>
> >
> >                <parameter name="service-access" type="string"
> > value="exclusive"/>
> >
> >            </deploymentParameters>
> >
> >            <errorHandling>
> >
> >                <errorRateThreshold action="continue" value="1/1000"/>
> >
> >                <maxConsecutiveRestarts action="continue" value="0"/>
> >
> >                <timeout max="30000" default="-1"/>
> >
> >            </errorHandling>
> >
> >            <checkpoint batch="1" time="1000ms"/>
> >
> >        </casProcessor>
> >
> >        <casProcessor deployment="integrated" name="CasConsumer">
> >
> >            <descriptor>
> >
> >                <include
> > href="/F:/....../descriptors/cas_consumers/XCasWriterCasConsumer.xml"/>
> >
> >            </descriptor>
> >
> >            <deploymentParameters/>
> >
> >            <errorHandling>
> >
> >                <errorRateThreshold action="terminate"
> > value="100/1000"/>
> >
> >                <maxConsecutiveRestarts action="terminate" value="30"/>
> >
> >                <timeout max="100000" default="-1"/>
> >
> >            </errorHandling>
> >
> >            <checkpoint batch="1" time="1000ms"/>
> >
> >            <configurationParameterSettings>
> >
> >                <nameValuePair>
> >
> >                    <name>OutputDirectory</name>
> >
> >                    <value>
> >
> >                        <string>c:/temp/XCasDirectory</string>
> >
> >                    </value>
> >
> >                </nameValuePair>
> >
> >            </configurationParameterSettings>
> >
> >        </casProcessor>
> >
> >    </casProcessors>
> >
> >    <cpeConfig>
> >
> >        <numToProcess>-1</numToProcess>
> >
> >        <deployAs>immediate</deployAs>
> >
> >        <checkpoint batch="0" time="300000ms"/>
> >
> >        <timerImpl/>
> >
> >    </cpeConfig>
> >
> > </cpeDescription>
> >
> >
>

Mime
View raw message