Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: neutral (asf.osuosl.org: local policy)
Date: Tue, 13 Dec 2005 17:55:52 -0500
From: Ira Goldstein <iragoldstein@usa.net>
To: <java-user@lucene.apache.org>, <java-user@lucene.apache.org>
Subject: Re: Impact of Term Vectors
Mime-Version: 1.0
Message-ID: <361JLmw416048S09.1134514552@cmsweb09.cms.usa.net>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Z-USANET-MsgId: XID501JLmw420497X37

We've run into an issue with the term vectors. When indexing a small corp=
us
(~3k docs, 1.3G) everything works fine, as it does with a small number of=

documents from TREC-6 (so we believe that our indexing code is ok).  Howe=
ver,
when we tried to index the full TREC-6 corpus (~300,000 docs, 2G) the ter=
m
vectors all seem to come back as null.  When the indexing process is goin=
g on,
we can see the .frq file being built so it appears as if the index routin=
e is
doing its thing.

Has anyone experienced anything similar?

Thanks in advance for any insight you can offer
--Ira Goldstein
  =


------ Original Message ------
Received: Tue, 13 Dec 2005 12:41:07 PM EST
From: "Dan Climan" <dcliman@keepmedia.com>
To: <java-user@lucene.apache.org>
Subject: Impact of Term Vectors (was ApacheCon next week)

> Good question. I was wondering about the impact of adding term vectors =
with
> the various options. For example, is adding term vectors with both
positions
> and offsets a significant impact? Which current parts of lucene (includ=
ing
> contributions) take advantage of term vectors being present? I know tha=
t
> Highlighter class can make use of them if present.
> =

> Dan
> =

> -----Original Message-----
> From: Jeff Rodenburg [mailto:jeff.rodenburg@gmail.com] =

> Sent: Monday, December 12, 2005 9:08 PM
> To: java-user@lucene.apache.org
> Subject: Re: ApacheCon next week
> =

> Well done, Grant.  Very informative.
> =

> Question on Term Vectors: with their inclusion in an index, have you
noticed
> any degradation in performance, either from a search effiiciency or
> maintenance point-of-view?  Given the power of term vectors, if the per=
f
> impact is negligible, I'm curious to the reasons why one would NOT incl=
ude
> term vectors in any and every index...
> =

> cheers,
> j
> =

> =

> =

> =

> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
> =

> =


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org