Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 64634 invoked from network); 16 Oct 2009 16:09:42 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 16 Oct 2009 16:09:42 -0000 Received: (qmail 97070 invoked by uid 500); 16 Oct 2009 16:09:39 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 97025 invoked by uid 500); 16 Oct 2009 16:09:39 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 97015 invoked by uid 99); 16 Oct 2009 16:09:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 16 Oct 2009 16:09:39 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of peterlkeegan@gmail.com designates 209.85.216.173 as permitted sender) Received: from [209.85.216.173] (HELO mail-px0-f173.google.com) (209.85.216.173) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 16 Oct 2009 16:09:29 +0000 Received: by pxi3 with SMTP id 3so2651199pxi.29 for ; Fri, 16 Oct 2009 09:09:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type; bh=1sM/f594TfMtOwxJm8Lz2liJJNPCV41YXXGAoVKZWTw=; b=vhW5etySM5J2LBKH+kBJAM0bIurf+hP1ajTL/AEEgAWzBze8p5ogMBApi1cNvCj/u/ cUD2GqhX+EkYDUv9L0jUYGNlP8Ky+shCnrn72kUY+JoEJ2DHMPF4suO7MbNH9IWx2qMO ipMk+J+AmO/q4nTbdYqm51RbMAEF3b3Lzn448= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=A7wA5MYIowtZAZyM54avYIzPIM1L4fha3/5kns5dx302VAaV1njNB6Xvo9A0vb/zkE kNoAKzkYZ2KDxF/uKc3fp0FO8JpO0lMKm2vo63sfqYtwtGS9HskCLyJNON5njyT0MAo0 U9esdVdGQew1l7aDkMG4GZlCL666FfTOUaXC0= MIME-Version: 1.0 Received: by 10.140.202.16 with SMTP id z16mr71337rvf.233.1255709347871; Fri, 16 Oct 2009 09:09:07 -0700 (PDT) In-Reply-To: References: <0B6370A3-6C21-49D3-80D7-047464CF3534@apache.org> Date: Fri, 16 Oct 2009 12:09:07 -0400 Message-ID: Subject: Re: NPE in NearSpansUnordered From: Peter Keegan To: java-user@lucene.apache.org Content-Type: multipart/alternative; boundary=000e0cd29db49efc5204760f9d30 X-Virus-Checked: Checked by ClamAV on apache.org --000e0cd29db49efc5204760f9d30 Content-Type: text/plain; charset=ISO-8859-1 I can reproduce this with a unit test - will post to JIRA shortly. Peter On Fri, Oct 16, 2009 at 8:06 AM, Peter Keegan wrote: > next() is called in PayloadNearQuery->setFreqCurrentDoc: > super.setFreqCurrentDoc(); > But, I think it should be called before 'getPayloads'. That doesn't fix the > NPE, though. > The empty PQ occurs in the outermost span in the query, and seems to fail > on the last document it scores. > Prior to 2.9, I'd been using a patch on 2.3.2. and never saw the NPE. > > Peter > > > On Fri, Oct 16, 2009 at 6:53 AM, Grant Ingersoll wrote: > >> And, you don't get this on 2.4.1? >> >> Are you sure you've called next()? Is it by chance on the first document >> it tries to score that it fails? >> >> -Grant >> >> >> >> >> On Oct 15, 2009, at 1:28 PM, Peter Keegan wrote: >> >> The query is: >>> +payloadNear([spanNear([contents:insurance, contents:agent], 10000, >>> false), >>> spanNear([contents:winston, contents:salem], 10000, false)], 10, false) >>> It's using the default payload function scorer (average value) >>> >>> It doesn't happen on all queries of this type, only a handful. This is >>> production-like index of > 1million docs. I haven't been able to >>> reproduce >>> with a simple index, unfortunately. >>> >>> Peter >>> >>> On Thu, Oct 15, 2009 at 1:21 PM, Yonik Seeley < >>> yonik@lucidimagination.com>wrote: >>> >>> Are you using any custom query types? Anything to help us reproduce >>>> (like the acutal query this happened on) would be greatly appreciated. >>>> >>>> -Yonik >>>> http://www.lucidimagination.com >>>> >>>> >>>> On Thu, Oct 15, 2009 at 1:17 PM, Peter Keegan >>>> wrote: >>>> >>>>> I'm using Lucene 2.9 and sometimes get a NPE in NearSpansUnordered: >>>>> >>>>> java.lang.NullPointerException >>>>> at >>>>> >>>>> org.apache.lucene.search.spans.NearSpansUnordered.start(NearSpansUnordered.java:219) >>>> >>>>> at >>>>> >>>>> org.apache.lucene.search.payloads.PayloadNearQuery$PayloadNearSpanScorer.processPayloads(PayloadNearQuery.java:201) >>>> >>>>> at >>>>> >>>>> org.apache.lucene.search.payloads.PayloadNearQuery$PayloadNearSpanScorer.getPayloads(PayloadNearQuery.java:180) >>>> >>>>> at >>>>> >>>>> org.apache.lucene.search.payloads.PayloadNearQuery$PayloadNearSpanScorer.getPayloads(PayloadNearQuery.java:183) >>>> >>>>> at >>>>> >>>>> org.apache.lucene.search.payloads.PayloadNearQuery$PayloadNearSpanScorer.setFreqCurrentDoc(PayloadNearQuery.java:214) >>>> >>>>> at >>>>> org.apache.lucene.search.spans.SpanScorer.nextDoc(SpanScorer.java:64) >>>>> at org.apache.lucene.search.Scorer.score(Scorer.java:74) >>>>> at >>>>> org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:247) >>>>> at org.apache.lucene.search.Searcher.search(Searcher.java:152) >>>>> >>>>> The CellQueue pq is empty when this occurs. Are there any conditions in >>>>> which the queue might be expected to be empty? >>>>> >>>>> Peter >>>>> >>>>> >>>> --------------------------------------------------------------------- >>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org >>>> For additional commands, e-mail: java-user-help@lucene.apache.org >>>> >>>> >>>> >> -------------------------- >> Grant Ingersoll >> http://www.lucidimagination.com/ >> >> Search the Lucene ecosystem (Lucene/Solr/Nutch/Mahout/Tika/Droids) using >> Solr/Lucene: >> http://www.lucidimagination.com/search >> >> >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org >> For additional commands, e-mail: java-user-help@lucene.apache.org >> >> > --000e0cd29db49efc5204760f9d30--