lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark Miller <markrmil...@gmail.com>
Subject Re: Field sizes: maxFieldLength
Date Mon, 11 Aug 2008 21:27:54 GMT
The gist is: it doesn't help. That simply cuts long documents off at the 
knees on the assumption that its long enough already, that more won't 
add much value (and may add noise?). Its not used for any sort of 
optimizations...its a straight, just use the first n tokens from a document.

Aravind.Yarram@equifax.com wrote:
> tx for the response but i think i didnt make my question clear...
>
> If i am indexing a filed that can at the max contain 1000 fileds, does it 
> help in improving performance if i let Lucene know IN ADVANCE about 1000?
>
>
>
>
>
>
> Mark Miller <markrmiller@gmail.com> 
> 08/11/2008 05:13 PM
> Please respond to
> java-user@lucene.apache.org
>
>
> To
> java-user@lucene.apache.org
> cc
>
> Subject
> Re: Field sizes: maxFieldLength
>
>
>
>
>
>
> Aravind.Yarram@equifax.com wrote:
>   
>> Hi all -
>>
>> I know in advance that each of the fileds i index doesnt go more than 
>> 1000, Can i gain any performance improvement while writing the index by 
>> limiting the maxFieldLength to 200? 
>>
>> tx
>> Regards, 
>> Aravind R Yarram 
>> This message contains information from Equifax Inc. which may be 
>>     
> confidential and privileged.  If you are not an intended recipient, please 
> refrain from any disclosure, copying, distribution or use of this 
> information and note that such actions are prohibited.  If you have 
> received this transmission in error, please notify by e-mail 
> postmaster@equifax.com.
>   
>>     
> Its 10000. Sure, if you have a lot of docs between 200 and 10000, 
> indexing less will be faster. But you will only be able to search on 
> those first 200 tokens for any doc longer.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
>
> This message contains information from Equifax Inc. which may be confidential and privileged.
 If you are not an intended recipient, please refrain from any disclosure, copying, distribution
or use of this information and note that such actions are prohibited.  If you have received
this transmission in error, please notify by e-mail postmaster@equifax.com.
>
>   


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message