uima-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jaroslaw Cwiklik <uim...@gmail.com>
Subject Re: UIMA-2.3 : CPE timeout problem with remote processors.
Date Mon, 05 Apr 2010 14:36:34 GMT
Muon, can you try to send the same big CAS (the first that worked) again to
see if the CPE handles the timeout correctly? Does your service receive the
second large CAS? I am trying to figure out if this is a problem with
serializing content of the second large CAS or something else.

Just a side note, if you are evaluating UIMA remoting capabilities, perhaps
you should try UIMA AS instead. UIMA AS is a replacement for the CPM. Based
on Open Source ActiveMQ, UIMA AS is a highly scalable framework for
deploying remote analytics. It scales to thousands of compute cores. Here is
a link where you'll find additional information:

http://incubator.apache.org/uima/doc-uimaas-what.html

JC

Muon, can you try to dispose previous instance of the CPE and create a new
one before sending another big CAS?

On Thu, Apr 1, 2010 at 3:05 AM, Muon Le <muon.le@temis.com> wrote:

> I did more tests about bigs XCas files (>100Ko).
> When I start my CPE with only one big XCas file, the CPE terminates
> properly with one timout error.
> Howerver, when I continue to start the same CPE with an other big XCas
> file, the CPE detects the timeout error and hangs.
>
> Thanks,
> Muon.
>
> -----Message d'origine-----
> De : Jaroslaw Cwiklik [mailto:uimaee@gmail.com]
> Envoyé : mercredi 31 mars 2010 18:12
> À : uima-user@incubator.apache.org
> Objet : Re: UIMA-2.3 : CPE timeout problem with remote processors.
>
> Hmm, your  previous description confused me:
>
> "More accuratly, with small files, there are errors about timeout, but the
> CPE terminates properly (without handling)."
>
> So you are not seeing any problems while processing small files. Its the
> big
> files that cause the timeout. Looking at
> the stack trace it seems like this is a problem in the Vinci
> Serializer/Deserializer. Not sure if this a problem with
> sending or receiving. Is your service receiving and processing a large CAS
> (file)? How large is the file?
>
> JC
>
> On Wed, Mar 31, 2010 at 10:27 AM, Muon Le <muon.le@temis.com> wrote:
>
> > Hello,
> >
> > No, with small files, there are no problems.
> >
> > No. Here is the description file:
> >   <?xml version="1.0" encoding="UTF-8" ?>
> > - <uriSpecifier xmlns="http://uima.apache.org/resourceSpecifier">
> >  <resourceType>AnalysisEngine</resourceType>
> >  <uri>com.temis.Default.SleepBSH</uri>
> >  <protocol>Vinci</protocol>
> >  </uriSpecifier>
> >
> > Yes, here is a sample of error message in logs:
> > WARN  - 2010-03-29 16:09:44,312 - [Procesing Pipeline#4 Thread]:: -
> > [MDC:{{docid,
> >
> http://www.ardenno.com/pressreleases/news_04sept07.php--Cnt6183}{module,Workflow}{host,racine}{submodule,racine}{workflow,Bug5092}}][THREAD:[ProcesingPipeline#4
> >
> Thread]::][LOGGER:org.apache.uima.collection.impl.cpm.container.deployer.VinciTAP][NDC:null]
> > java.net.SocketTimeoutException: Read timed out
> >        at java.net.SocketInputStream.socketRead0(Native Method)
> >        at java.net.SocketInputStream.read(Unknown Source)
> >        at java.io.BufferedInputStream.fill(Unknown Source)
> >        at java.io.BufferedInputStream.read(Unknown Source)
> >        at
> >
> org.apache.vinci.transport.XTalkTransporter.fromStream(XTalkTransporter.java:61)
> >        at org.apache.vinci.transport.Frame.fromStream(Frame.java:150)
> >        at
> >
> org.apache.vinci.transport.BaseClient.sendAndReceiveWork(BaseClient.java:650)
> >        at
> >
> org.apache.vinci.transport.BaseClient.sendAndReceiveWork(BaseClient.java:666)
> >        at
> > org.apache.vinci.transport.BaseClient.sendAndReceive(BaseClient.java:383)
> >        at
> >
> org.apache.uima.collection.impl.cpm.container.deployer.VinciTAP.sendAndReceive(VinciTAP.java:453)
> >        at
> >
> org.apache.uima.collection.impl.cpm.container.deployer.VinciTAP.analyze(VinciTAP.java:927)
> >        at
> >
> org.apache.uima.collection.impl.cpm.container.NetworkCasProcessorImpl.process(NetworkCasProcessorImpl.java:198)
> >        at
> >
> org.apache.uima.collection.impl.cpm.engine.ProcessingUnit.processNext(ProcessingUnit.java:826)
> >        at
> >
> org.apache.uima.collection.impl.cpm.engine.ProcessingUnit.run(ProcessingUnit.java:577)
> >
> > Thanks for your helps.
> > Muon.
> >
> > -----Message d'origine-----
> > De : Jaroslaw Cwiklik [mailto:uimaee@gmail.com]
> > Envoyé : mercredi 31 mars 2010 15:39
> > À : uima-user@incubator.apache.org
> > Objet : Re: UIMA-2.3 : CPE timeout problem with remote processors.
> >
> > Do you also observe a hang with small files?
> > Does client descriptor c:\temp\AnnotClient_Default_SleepBSH.xml name the
> > same vns host and port that the service is using?
> > Any exceptions in logs( service or client side)?
> > JC
> >
> > On Tue, Mar 30, 2010 at 9:21 AM, Muon Le <muon.le@temis.com> wrote:
> >
> > > Hello,
> > >
> > >
> > >
> > > I launch a simple CPE (see bellow) that maintains a remote processor
> > > with a timeout defined at 30000ms.
> > >
> > > The CPE hangs when the processor processes bigs files (10 files >
> 100ko)
> > > despite the timeout value.
> > >
> > >
> > >
> > > Do you have any idea of this problem ?
> > >
> > >
> > >
> > > Thanks in advance,
> > >
> > > Muon.
> > >
> > > PS. My CPE description :
> > >
> > >
> > >
> > > <?xml version="1.0" encoding="UTF-8"?>
> > >
> > > <cpeDescription xmlns="http://uima.apache.org/resourceSpecifier">
> > >
> > >    <collectionReader>
> > >
> > >        <collectionIterator>
> > >
> > >            <descriptor>
> > >
> > >                <include
> > >
> href="/F:/...../descriptors/collection_readers/XCasCollectionReader.xml"
> > > />
> > >
> > >            </descriptor>
> > >
> > >            <configurationParameterSettings>
> > >
> > >                <nameValuePair>
> > >
> > >                    <name>InputDirectory</name>
> > >
> > >                    <value>
> > >
> > >                        <string>g:/Luxid/bugs/5092/data/xcas</string>
> > >
> > >                    </value>
> > >
> > >                </nameValuePair>
> > >
> > >            </configurationParameterSettings>
> > >
> > >        </collectionIterator>
> > >
> > >    </collectionReader>
> > >
> > >    <casProcessors casPoolSize="5" processingUnitThreadCount="4">
> > >
> > >        <casProcessor deployment="remote" name="SleepBSH">
> > >
> > >            <descriptor>
> > >
> > >                <include
> > > href="c:\temp\AnnotClient_Default_SleepBSH.xml"/>
> > >
> > >            </descriptor>
> > >
> > >            <deploymentParameters>
> > >
> > >                <parameter name="vnsHost" type="string" value=" ???"/>
> > >
> > >                <parameter name="vnsPort" type="string" value="9000"/>
> > >
> > >                <parameter name="service-access" type="string"
> > > value="exclusive"/>
> > >
> > >            </deploymentParameters>
> > >
> > >            <errorHandling>
> > >
> > >                <errorRateThreshold action="continue" value="1/1000"/>
> > >
> > >                <maxConsecutiveRestarts action="continue" value="0"/>
> > >
> > >                <timeout max="30000" default="-1"/>
> > >
> > >            </errorHandling>
> > >
> > >            <checkpoint batch="1" time="1000ms"/>
> > >
> > >        </casProcessor>
> > >
> > >        <casProcessor deployment="integrated" name="CasConsumer">
> > >
> > >            <descriptor>
> > >
> > >                <include
> > > href="/F:/....../descriptors/cas_consumers/XCasWriterCasConsumer.xml"/>
> > >
> > >            </descriptor>
> > >
> > >            <deploymentParameters/>
> > >
> > >            <errorHandling>
> > >
> > >                <errorRateThreshold action="terminate"
> > > value="100/1000"/>
> > >
> > >                <maxConsecutiveRestarts action="terminate" value="30"/>
> > >
> > >                <timeout max="100000" default="-1"/>
> > >
> > >            </errorHandling>
> > >
> > >            <checkpoint batch="1" time="1000ms"/>
> > >
> > >            <configurationParameterSettings>
> > >
> > >                <nameValuePair>
> > >
> > >                    <name>OutputDirectory</name>
> > >
> > >                    <value>
> > >
> > >                        <string>c:/temp/XCasDirectory</string>
> > >
> > >                    </value>
> > >
> > >                </nameValuePair>
> > >
> > >            </configurationParameterSettings>
> > >
> > >        </casProcessor>
> > >
> > >    </casProcessors>
> > >
> > >    <cpeConfig>
> > >
> > >        <numToProcess>-1</numToProcess>
> > >
> > >        <deployAs>immediate</deployAs>
> > >
> > >        <checkpoint batch="0" time="300000ms"/>
> > >
> > >        <timerImpl/>
> > >
> > >    </cpeConfig>
> > >
> > > </cpeDescription>
> > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message