Mailing-List: contact java-dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-dev@lucene.apache.org
Received-SPF: neutral (asf.osuosl.org: local policy)
Mime-Version: 1.0 (Apple Message framework v746.3)
In-Reply-To: <1EA05F85-9874-48C2-A616-3E35C74AC3E9@snigel.net>
References: <53423917-9808-4EA8-996A-95F7CD6218FD@snigel.net>
 <443FCE53.9050707@apache.org>
 <678FBE2D-7BDF-4609-ADF3-4B4BD2844BEB@snigel.net>
 <200604152132.18437.paul.elschot@xs4all.nl>
 <230F88BC-DC49-4128-9303-DE2FE4E2FED8@snigel.net>
 <58912026-8F34-4D9D-80B7-13D89CC16591@snigel.net>
 <5A2ED106-2378-488C-8009-CF3239EF00FF@snigel.net>
 <1EA05F85-9874-48C2-A616-3E35C74AC3E9@snigel.net>
Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed
Message-Id: <0DE6108C-00D7-41F1-8518-6FC7E3918B77@snigel.net>
Content-Transfer-Encoding: 7bit
From: karl wettin <kalle@snigel.net>
Subject: Re: Using Lucene for searching tokens, not storing them.
Date: Thu, 20 Apr 2006 07:47:02 +0200
To: java-dev@lucene.apache.org


20 apr 2006 kl. 07.29 skrev karl wettin:

>
> 18 apr 2006 kl. 22.08 skrev karl wettin:
>
>> After adding a couple of binary searches in well needed places  
>> (and a couple of new bugs that in a few cases affects the results)  
>> I'm now down at 1/8th of the time compared to RAMDirectory. That  
>> is really fast if you ask me.
>
> After fixing the bugs, it's now 4.5 -> 5 times the speed. This is  
> true for both at index and query time. Sorry if I got your hopes up  
> too much. There are still things to be done though. Might not have  
> time to do anything with this until next month, so here is the code  
> if anyone wants a peek.
>
> Not good enough for Jira yet, but if someone wants to fool around  
> with it, here it is. The implementation passes a TermEnum ->  
> TermDocs -> Fields -> TermVector comparation against the same data  
> in a Directory.
>
> When it comes to features, offsets don't exists and positions are  
> stored ugly and has bugs.
>
> You might notice that norms are float[] and not byte[]. That is me  
> who refactored it to see if it would do any good. Bit shifting  
> don't take many ticks, so I might just revert that.
>
> I belive the code is quite self explaining.
>
> InstanciatedIndex ii = ..
> ii.new InstanciatedIndexReader();
> ii.addDocument(s).. replace IndexWriter for now.

No attachments allowed ey?

Ok, I'll pop it in the Jira then.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org