Mailing-List: contact lucy-dev-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: lucy-dev@incubator.apache.org
Received-SPF: neutral (athena.apache.org: local policy)
Message-ID: <4E698747.3050806@peknet.com>
Date: Thu, 08 Sep 2011 22:25:59 -0500
From: Peter Karman <peter@peknet.com>
Reply-To: peter@peknet.com
User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US;
 rv:1.9.2.18) Gecko/20110616 Thunderbird/3.1.11
MIME-Version: 1.0
To: Marvin Humphrey <marvin@rectangular.com>,
 lucy-dev@incubator.apache.org
References: <4E5D2E2F.70006@peknet.com>
 <20110830215906.GA10870@rectangular.com>
In-Reply-To: <20110830215906.GA10870@rectangular.com>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Subject: [lucy-dev] Re: which fields contained which terms

Marvin Humphrey wrote on 8/30/11 4:59 PM:

> To support highlighting, at index-time we create an inverted representation
> for each field that has been marked as "highlightable", then serialize all the
> inverted fields together in one blob (called, for no particularly good reason,
> a "DocVector").  Effectively this is a miniature inverted-index containing a
> single document.  The class which does the work is
> Lucy::Index::HighlightWriter, and the relevant segment files are named
> seg_NNN/highlight.ix and seg_NNN/highlight.dat.

I finally found time to try this, but I must be doing something wrong, because
despite setting all my fields to 'highlightable', no seg_NNN/highlight.* files
are getting created.

here's a snip from schema_1.json:

   "fields" : {
      "author" : {
         "analyzer" : "1",
         "highlightable" : "1",
         "sortable" : "1",
         "type" : "fulltext"
      },
      "dates" : {
         "analyzer" : "1",
         "highlightable" : "1",
         "sortable" : "1",
         "type" : "fulltext"
      },
      "orgs" : {
         "analyzer" : "1",
         "highlightable" : "1",
         "sortable" : "1",
         "type" : "fulltext"
      },

and here's what my index dir looks like:

index.swish3]$ tree
.
|-- locks
|-- schema_1.json
|-- seg_1
|   |-- cf.dat
|   |-- cfmeta.json
|   `-- segmeta.json
|-- snapshot_1.json
|-- swish.xml
`-- swish_last_start

2 directories, 7 files


-- 
Peter Karman  .  http://peknet.com/  .  peter@peknet.com