Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of karl.wettin@gmail.com
 designates 209.85.219.21 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:from:to:in-reply-to:content-type
         :content-transfer-encoding:mime-version:subject:date:references
         :x-mailer;
        b=ZVMTeMp8WX7S1tx4zVYyMj5iYW+5C4Fni/nN2CQAorMa+T14H2E1BMk4YsSyGkVom4
         0J1v6kEEFxcQZodVShfkHn6yX7sNC5v53reTPs709M2RBlH4mA3FBZ9ENvnJuT0Dm7+A
         xE8aRI2XiMHHYxnC8OUIS+ErgH+7oL/z5cNn0=
Message-Id: <BBA4C509-E17B-4504-8244-40A1817A6D25@gmail.com>
From: Karl Wettin <karl.wettin@gmail.com>
To: java-user@lucene.apache.org
In-Reply-To: <559869.2560.qm@web112218.mail.gq1.yahoo.com>
Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes
Content-Transfer-Encoding: 7bit
Mime-Version: 1.0 (Apple Message framework v930.3)
Subject: Re: Extract the text that was indexed
Date: Wed, 31 Dec 2008 01:30:05 +0100
References: <410194.56701.qm@web112210.mail.gq1.yahoo.com>
  <11975c90812300431h31c9719w50a367a2ee80a1c@mail.gmail.com>
  <b63a7e9e0812300640x2a197cceu4cc83d0b130b3ada@mail.gmail.com>
 <359a92830812300741u50ac5c4cq45d5236595fe7c6c@mail.gmail.com>
 <559869.2560.qm@web112218.mail.gq1.yahoo.com>

30 dec 2008 kl. 17.13 skrev Lebiram:

Hi Lebiram,

contrib/misc contains a couple of tools that might be of help.

> Just wanted to reconstruct a new index based on an existing  
> index(but turning off norms) that's all.

If you want to create an identical index but without norms use  
FieldNormModifier in contrib/miscellaneous.

> However, as it is nearly impossible to extract the terms  of  
> unstored fields, we might think of other ways.

Not impossible, just time consuming. The easiest way is to reconstruct  
the token stream of each field using the term frequency vector. If you  
haven't stored it there is a class called TermVectorAccessor in  
contrib/miscellaneous that allows you to visit the term vector even  
though it is not store, i.e. it will construct it be enumerating the  
inverted index.

Remember that if you reconstruct a token stream via the term vector no  
payloads will be available. If you use payloads it would be a simple  
thing to patch TermVectorAccessor in order to set the payloads in the  
tokens. Feel free to post such a patch in the Jira, it would be a nice  
addition to that code.


     karl


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org