lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tommaso Teofili <tommaso.teof...@gmail.com>
Subject Re: [JENKINS] Lucene-Solr-tests-only-trunk-java7 - Build # 1738 - Still Failing
Date Wed, 15 Feb 2012 17:22:59 GMT
Hi Robert,

2012/2/15 Robert Muir <rcmuir@gmail.com>

> I think these are thread-safety problems related to using the same
> analysis engine instance?
>
> See prototype patch on
> https://issues.apache.org/jira/browse/LUCENE-3731, this is also
> causing some performance issues I think.
>
> Currently I think because no CAS is reused, its just slow and the
> possibility of thread problems is low. But by reusing CAS, these tests
> run much faster (and of course then fail).
>
> In the prototype patch as a workaround, i added this:
> +    // nocommit: how can we get our 'own' analysis engine from the
> factory?
> +    synchronized(analysisEngine) {
> +      analysisEngine.process(cas);
> +    }
>
> But I don't think we should do this... we should avoid the sync here.
> Instead of caching in the AEFactory maybe each tokenstream should get
> its own AnalysisEngine so there is no sync?
>

this may be the easy fix which should get the bar green again.
I think we should go for this now.


> Otherwise, I think we need to look at something like
>
> http://uima.apache.org/d/uimaj-2.4.0/apidocs/org/apache/uima/UIMAFramework.html#produceAnalysisEngine%28org.apache.uima.resource.ResourceSpecifier,%20int,%20int%29
> which can process multiple requests simultaneously, but I'm not
> familiar enough with the UIMA apis to know whats best here.
>

IMHO the best thing in the long run would be using UIMA-AS (SOLR-3014) to
face high performance and concurrency tasks, right now I'm doing different
tests locally in order to come up with the best solution (see LUCENE-3731).

Tommaso


>
> On Wed, Feb 15, 2012 at 11:37 AM, Apache Jenkins Server
> <jenkins@builds.apache.org> wrote:
> > Build:
> https://builds.apache.org/job/Lucene-Solr-tests-only-trunk-java7/1738/
> >
> > 2 tests failed.
> > FAILED:
>  org.apache.lucene.analysis.uima.UIMABaseAnalyzerTest.testRandomStrings
> >
> > Error Message:
> > java.lang.AssertionError: Some threads threw uncaught exceptions!
> >
> > Stack Trace:
> > java.lang.RuntimeException: java.lang.AssertionError: Some threads threw
> uncaught exceptions!
> >        at
> org.apache.lucene.util.LuceneTestCase.tearDownInternal(LuceneTestCase.java:773)
> >        at
> org.apache.lucene.util.LuceneTestCase.access$1000(LuceneTestCase.java:131)
> >        at
> org.apache.lucene.util.LuceneTestCase$InternalSetupTeardownRule$1.evaluate(LuceneTestCase.java:600)
> >        at
> org.apache.lucene.util.LuceneTestCase$TestResultInterceptorRule$1.evaluate(LuceneTestCase.java:504)
> >        at
> org.apache.lucene.util.LuceneTestCase$RememberThreadRule$1.evaluate(LuceneTestCase.java:562)
> >        at
> org.apache.lucene.util.LuceneTestCaseRunner.runChild(LuceneTestCaseRunner.java:165)
> >        at
> org.apache.lucene.util.LuceneTestCaseRunner.runChild(LuceneTestCaseRunner.java:57)
> >        at
> org.apache.lucene.util.LuceneTestCase.checkUncaughtExceptionsAfter(LuceneTestCase.java:801)
> >        at
> org.apache.lucene.util.LuceneTestCase.tearDownInternal(LuceneTestCase.java:745)
> >
> >
> > FAILED:
>  org.apache.lucene.analysis.uima.UIMATypeAwareAnalyzerTest.testRandomStrings
> >
> > Error Message:
> > java.lang.AssertionError: Some threads threw uncaught exceptions!
> >
> > Stack Trace:
> > java.lang.RuntimeException: java.lang.AssertionError: Some threads threw
> uncaught exceptions!
> >        at
> org.apache.lucene.util.LuceneTestCase.tearDownInternal(LuceneTestCase.java:773)
> >        at
> org.apache.lucene.util.LuceneTestCase.access$1000(LuceneTestCase.java:131)
> >        at
> org.apache.lucene.util.LuceneTestCase$InternalSetupTeardownRule$1.evaluate(LuceneTestCase.java:600)
> >        at
> org.apache.lucene.util.LuceneTestCase$TestResultInterceptorRule$1.evaluate(LuceneTestCase.java:504)
> >        at
> org.apache.lucene.util.LuceneTestCase$RememberThreadRule$1.evaluate(LuceneTestCase.java:562)
> >        at
> org.apache.lucene.util.LuceneTestCaseRunner.runChild(LuceneTestCaseRunner.java:165)
> >        at
> org.apache.lucene.util.LuceneTestCaseRunner.runChild(LuceneTestCaseRunner.java:57)
> >        at
> org.apache.lucene.util.LuceneTestCase.checkUncaughtExceptionsAfter(LuceneTestCase.java:801)
> >        at
> org.apache.lucene.util.LuceneTestCase.tearDownInternal(LuceneTestCase.java:745)
> >
> >
> >
> >
> > Build Log (for compile errors):
> > [...truncated 5211 lines...]
> >
> >
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> > For additional commands, e-mail: dev-help@lucene.apache.org
>
>
>
> --
> lucidimagination.com
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
>

Mime
View raw message