lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Uwe Schindler" <...@thetaphi.de>
Subject RE: NPE Within IndexWriter.optimize (Solr Trunk Nightly)
Date Tue, 25 May 2010 16:10:02 GMT
There is one possibility this error can occur. Maybe you extracted the build
onto an existing (previous) snapshot folder. As the Lucene JARS contain
version numbers it may be the case that an old JAR file is now mixed between
the new ones and so these errors can occur.

Please extract to an empty folder and put your indexes there (if you created
some before).

Please note: The trunk version has no stable index format, indexes may
corrupt easily. If you want a "preview" on the coming stable version,
download the 3.1 Artifacts (not 4.0):
http://hudson.zones.apache.org/hudson/job/Solr-3.x/lastSuccessfulBuild/artif
act/branch_3x/solr/dist/

-----
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: uwe@thetaphi.de

> -----Original Message-----
> From: Chris Herron [mailto:cherro@gmail.com]
> Sent: Tuesday, May 25, 2010 5:38 PM
> To: dev@lucene.apache.org
> Subject: Re: NPE Within IndexWriter.optimize (Solr Trunk Nightly)
> 
> Uwe, Mike,
> 
> I downloaded the nightly build by visiting the wiki:
> http://wiki.apache.org/solr/FrontPage
> ... and then clicking on "Download newest Solr nightly build here"
> http://hudson.zones.apache.org/hudson/job/Solr-
> trunk/lastSuccessfulBuild/artifact/trunk/solr/dist/
> The exact file I download yesterday was:
> http://hudson.zones.apache.org/hudson/job/Solr-
> trunk/lastSuccessfulBuild/artifact/trunk/solr/dist/apache-solr-2010-05-
> 24_08-05-13.tgz (no longer exists).
> 
> I have no patches or mods added. The CHANGES.txt file in the download
> includes this:
> 
> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> ~~~~~~~~~~~
> $Id: CHANGES.txt 945897 2010-05-18 21:30:41Z hossman $
> 
> ==================  4.0.0-dev ================== Versions of Major
> Components
> ---------------------
> Apache Lucene trunk
> Apache Tika 0.6
> Carrot2 3.1.0
> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> ~~~~~~~~~~~
> 
> Did I fetch the wrong version? If so, where can I grab the (1.5.x) nightly
> builds?
> 
> Mike, thanks for the CheckIndex suggestion. Shall run that once I've
> confirmed which version I'm running.
> 
> Thanks,
> 
> Chris
> 
> On May 25, 2010, at 5:09 AM, Uwe Schindler wrote:
> 
> > Maybe it's the 3x version?
> >
> > The artifact names in Hudson are currently identical for solr-trunk
> > and solr-3x. You have to specifiy which version you use!
> >
> > -----
> > Uwe Schindler
> > H.-H.-Meier-Allee 63, D-28213 Bremen
> > http://www.thetaphi.de
> > eMail: uwe@thetaphi.de
> >
> >> -----Original Message-----
> >> From: Michael McCandless [mailto:lucene@mikemccandless.com]
> >> Sent: Tuesday, May 25, 2010 11:01 AM
> >> To: dev@lucene.apache.org
> >> Subject: Re: NPE Within IndexWriter.optimize (Solr Trunk Nightly)
> >>
> >> Hmmm spooky.
> >>
> >> For some reason I can't correlate the line numbers in
> >> TermInfosReader.java the current trunk sources; the line numbers for
> >> all the other sources line
> > up.
> >> This is a stock nightly build right?
> >> You don't have any mods/patches?
> >>
> >> Can you enable assertions when you optimize and see if anything trips?
> >>
> >> Also, can you run CheckIndex on your index (java -ea
> >> org.apache.lucene.index.CheckIndex /path/to/index), and post the
> output?
> >>
> >> Mike
> >>
> >> On Mon, May 24, 2010 at 7:43 PM, Chris Herron <cherro@gmail.com>
> wrote:
> >>> Hi,
> >>>
> >>> I'm using the latest nightly build of solr
> > (apache-solr-2010-05-24_08-05-13)
> >> and am repeatedly experiencing a NullPointerException after calling
> > delete,
> >> commit, optimize. Stack trace below. The index is ~20Gb.
> >>>
> >>> I'm not doing Lucene/Solr core development - I just figured this was
> >>> a
> >> better place to ask given that this was a nightly build.
> >>>
> >>> Any observations that would help resolve?
> >>>
> >>> Thanks,
> >>>
> >>> Chris
> >>>
> >>> SEVERE: java.io.IOException: background merge hit exception:
> >>> _gr5a:C127 _gsbj:C486/3 _gsbk:C1 _gsbl:C1/1 _gsbm:C1 _gsbn:C1
> >>> _gsbo:C1
> >>> _gsbp:C1 _gsbq:C1 _gssn:C69 into _gsss [optimize] [mergeDocStores]
> >>>        at
> >>> org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:2418)
> >>>        at
> >>> org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:2343)
> >>>        at
> >>>
> >>
> org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandle
> >> r
> >>> 2.java:403)
> >>>        at
> >>>
> >>
> org.apache.solr.update.processor.RunUpdateProcessor.processCommit(Run
> >> U
> >>> pdateProcessorFactory.java:85)
> >>>        at
> >>>
> >>
> org.apache.solr.handler.RequestHandlerUtils.handleCommit(RequestHandl
> >> e
> >>> rUtils.java:107)
> >>>        at
> >>>
> >>
> org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(Co
> >> n
> >>> tentStreamHandlerBase.java:48)
> >>>        at
> >>>
> >>
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandl
> >> e
> >>> rBase.java:131)
> >>>        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1321)
> >>>        at
> >>> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.
> >>> java:341)
> >>>        at
> >>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilt
> >>> er
> >>> .java:244)
> >>>        at
> >>> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(Servle
> >>> tH
> >>> andler.java:1190)
> >>>        at
> >>> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:
> >>> 424)
> >>>        at
> >>> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.
> >>> ja
> >>> va:119)
> >>>        at
> >>> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.ja
> >>> va
> >>> :457)
> >>>        at
> >>> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHand
> >>> le
> >>> r.java:229)
> >>>        at
> >>> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHand
> >>> le
> >>> r.java:931)
> >>>        at
> >>> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java
> >>> :3
> >>> 61)
> >>>        at
> >>> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandl
> >>> er
> >>> .java:186)
> >>>        at
> >>> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandl
> >>> er
> >>> .java:867)
> >>>        at
> >>> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.
> >>> ja
> >>> va:117)
> >>>        at
> >>> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(Con
> >>> te
> >>> xtHandlerCollection.java:245)
> >>>        at
> >>> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCol
> >>> le
> >>> ction.java:126)
> >>>        at
> >>>
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.
> >>> java:113)
> >>>        at org.eclipse.jetty.server.Server.handle(Server.java:337)
> >>>        at
> >>> org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection
> >>> .j
> >>> ava:581)
> >>>        at
> >>>
> >>
> org.eclipse.jetty.server.HttpConnection$RequestHandler.headerComplete
> >> (
> >>> HttpConnection.java:1005)
> >>>        at
> >>> org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:560)
> >>>        at
> >>> org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:222)
> >>>        at
> >>> org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:4
> >>> 17
> >>> )
> >>>        at
> >>> org.eclipse.jetty.io.nio.SelectChannelEndPoint.run(SelectChannelEndP
> >>> oi
> >>> nt.java:474)
> >>>        at
> >>>
> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.
> >>> java:437)
> >>>        at java.lang.Thread.run(Thread.java:619)
> >>> Caused by: java.lang.NullPointerException
> >>>        at
> >>>
> >>
> org.apache.lucene.index.codecs.preflex.TermInfosReader.seekEnum(TermI
> >> n
> >>> fosReader.java:224)
> >>>        at
> >>>
> >>
> org.apache.lucene.index.codecs.preflex.TermInfosReader.seekEnum(TermI
> >> n
> >>> fosReader.java:214)
> >>>        at
> >>>
> >>
> org.apache.lucene.index.codecs.preflex.PreFlexFields$PreTermsEnum.res
> >> e
> >>> t(PreFlexFields.java:251)
> >>>        at
> >>> org.apache.lucene.index.codecs.preflex.PreFlexFields$PreFlexFieldsEn
> >>> um
> >>> .terms(PreFlexFields.java:198)
> >>>        at
> >>>
> org.apache.lucene.index.MultiFieldsEnum.terms(MultiFieldsEnum.java:1
> >>> 03
> >>> )
> >>>        at
> >>>
> >>
> org.apache.lucene.index.codecs.FieldsConsumer.merge(FieldsConsumer.ja
> >> v
> >>> a:48)
> >>>        at
> >>>
> >>
> org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.jav
> >> a:64
> >>> 7)
> >>>        at
> >>>
> >>
> org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:151)
> >>>        at
> >>>
> >>
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4414
> >> )
> >>>        at
> >>> org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4038)
> >>>        at
> >>>
> >>
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(Concurrent
> >> Mer
> >>> geScheduler.java:339)
> >>>        at
> >>>
> >>
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(Co
> >> ncu
> >>> rrentMergeScheduler.java:407)
> >>>
> >>> Exception in thread "Lucene Merge Thread #0"
> >>> org.apache.lucene.index.MergePolicy$MergeException:
> >>> java.lang.NullPointerException
> >>>        at
> >>>
> >>
> org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeExceptio
> >> n(
> >>> ConcurrentMergeScheduler.java:471)
> >>>        at
> >>>
> >>
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(Co
> >> ncu
> >>> rrentMergeScheduler.java:435) Caused by:
> >>> java.lang.NullPointerException
> >>>        at
> >>>
> >>
> org.apache.lucene.index.codecs.preflex.TermInfosReader.seekEnum(TermI
> >> n
> >>> fosReader.java:224)
> >>>        at
> >>>
> >>
> org.apache.lucene.index.codecs.preflex.TermInfosReader.seekEnum(TermI
> >> n
> >>> fosReader.java:214)
> >>>        at
> >>>
> >>
> org.apache.lucene.index.codecs.preflex.PreFlexFields$PreTermsEnum.res
> >> e
> >>> t(PreFlexFields.java:251)
> >>>        at
> >>> org.apache.lucene.index.codecs.preflex.PreFlexFields$PreFlexFieldsEn
> >>> um
> >>> .terms(PreFlexFields.java:198)
> >>>        at
> >>>
> org.apache.lucene.index.MultiFieldsEnum.terms(MultiFieldsEnum.java:1
> >>> 03
> >>> )
> >>>        at
> >>>
> >>
> org.apache.lucene.index.codecs.FieldsConsumer.merge(FieldsConsumer.ja
> >> v
> >>> a:48)
> >>>        at
> >>>
> >>
> org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.jav
> >> a:64
> >>> 7)
> >>>        at
> >>>
> >>
> org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:151)
> >>>        at
> >>>
> >>
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4414
> >> )
> >>>        at
> >>> org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4038)
> >>>        at
> >>>
> >>
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(Concurrent
> >> Mer
> >>> geScheduler.java:339)
> >>>        at
> >>>
> >>
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(Co
> >> ncu
> >>> rrentMergeScheduler.java:407)
> >>>
> >>>
> >>> --------------------------------------------------------------------
> >>> - To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For
> >>> additional commands, e-mail: dev-help@lucene.apache.org
> >>>
> >>>
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For
> >> additional commands, e-mail: dev-help@lucene.apache.org
> >
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For
> > additional commands, e-mail: dev-help@lucene.apache.org
> >
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional
> commands, e-mail: dev-help@lucene.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message