lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mark Miller" <markrmil...@gmail.com>
Subject Re: Field sizes: maxFieldLength
Date Mon, 11 Aug 2008 21:32:02 GMT
No. Its just a simple number of terms taken from the document limiter used
on the assumption that text that long stops adding value, or starts adding
noise, or starts accelerating into diminishing returns at that point. No
optimizations are used based on it.

On Mon, Aug 11, 2008 at 5:20 PM, <Aravind.Yarram@equifax.com> wrote:

> tx for the response but i think i didnt make my question clear...
>
> If i am indexing a filed that can at the max contain 1000 fileds, does it
> help in improving performance if i let Lucene know IN ADVANCE about 1000?
>
>
>
>
>
>
> Mark Miller <markrmiller@gmail.com>
> 08/11/2008 05:13 PM
> Please respond to
> java-user@lucene.apache.org
>
>
> To
> java-user@lucene.apache.org
> cc
>
> Subject
> Re: Field sizes: maxFieldLength
>
>
>
>
>
>
> Aravind.Yarram@equifax.com wrote:
> > Hi all -
> >
> > I know in advance that each of the fileds i index doesnt go more than
> > 1000, Can i gain any performance improvement while writing the index by
> > limiting the maxFieldLength to 200?
> >
> > tx
> > Regards,
> > Aravind R Yarram
> > This message contains information from Equifax Inc. which may be
> confidential and privileged.  If you are not an intended recipient, please
> refrain from any disclosure, copying, distribution or use of this
> information and note that such actions are prohibited.  If you have
> received this transmission in error, please notify by e-mail
> postmaster@equifax.com.
> >
> >
> Its 10000. Sure, if you have a lot of docs between 200 and 10000,
> indexing less will be faster. But you will only be able to search on
> those first 200 tokens for any doc longer.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
>
> This message contains information from Equifax Inc. which may be
> confidential and privileged.  If you are not an intended recipient, please
> refrain from any disclosure, copying, distribution or use of this
> information and note that such actions are prohibited.  If you have received
> this transmission in error, please notify by e-mail postmaster@equifax.com
> .
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message