lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erik Hatcher <e...@ehatchersolutions.com>
Subject Re: Why are tokens not being indexed?
Date Mon, 05 Dec 2005 18:42:18 GMT
Craig,

Again, please try a TermQuery(new Term(fieldname, value)) for a known  
field/term combination that you are having issues with.   
MultiFieldQueryParser is adding complexity on top of complexity.   
Start simple, get a known term query to work, and move up from there.

	Erik


On Dec 5, 2005, at 12:39 PM, Combs, Craig wrote:

> I'm able to see the documents that were indexed but not the tokens
> associated with the document in Luke.
>
> I'm using the multifield query parser and I did do the  
> query.toString and
> the tokens returned by the query parser matched the tokens returned  
> from the
> analyzer.  Some how I need to see which tokens are associated with  
> what
> documents in the Lucene index database.
>
> I'm not sure Luke can do this.  I don't need to know which  
> documents were
> indexed but I need to know what tokens are actually indexed in  
> lucene.  What
> is the best way to look into an index that Lucene has created and what
> tokens are associated with that given index.
>
> -Craig
>
> -----Original Message-----
> From: Erik Hatcher [mailto:erik@ehatchersolutions.com]
> Sent: Monday, December 05, 2005 12:23 PM
> To: java-user@lucene.apache.org
> Subject: Re: Why are tokens not being indexed?
>
>
> On Dec 5, 2005, at 8:20 AM, Combs, Craig wrote:
>> This is very mysterious
>>
>> I have check my parser and I'm returned body:<token>.  My analyzer
>> during
>> indexing returns <token> in the token stream.  But when I perform
>> my search
>> no results are found.
>>
>> Is there a way I can see what tokens are actually written by the  
>> index
>> writer of lucene?
>
> My java.net article and the (free) code from lucenebook.com has an
> analyzer demo that will show what comes out of the analyzer, but
> sounds like you've already troubleshot that aspect.
>
> Luke (google for "luke lucene") will let you see what got indexed - I
> recommend trying that out.
>
>> My analyzer returns the tokens and my queryparser returns the
>> tokens so I'm
>> not sure why "SOME" tokens are not being found in the index.  These
>> are
>> tokens in the middle of a token stream so it's not like they are at
>> the end
>> or beginning, and I have not found a pattern to them yet.
>
> Are you searching with QueryParser?   If you look at the generated
> Query.toString() does it match what you indexed?   If not, try a
> simple TermQuery for what gets returned from your analyzer and see if
> that works.  If not, Lucene is broken :)
>
> 	Erik
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
>
> The contents of this e-mail are intended for the named addressee  
> only. It
> contains information that may be confidential. Unless you are the  
> named
> addressee or an authorized designee, you may not copy or use it, or  
> disclose
> it to anyone else. If you received it in error please notify us  
> immediately
> and then destroy it.
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message