Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of rcmuir@gmail.com designates
 74.125.82.46 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CALm0H54B3jCGJzv+x=Oy5rwPWmpCjCzNuh8Bg4ZThhpragKbFA@mail.gmail.com>
References: 
 <CALm0H55u1SW4tncN3J3k7tJL25skVyfRwSDCJedr8fkqC=Ww0g@mail.gmail.com>
 <CAOdYfZVXp6a7qESAgYeACw7GLahSApeqXMOL1-WGyf-9A9_zgg@mail.gmail.com>
 <CALm0H577Vr5T3a=BrcsExd9mxC5bOxe-jiCZ7hVcervsm1qCQw@mail.gmail.com>
 <CAOdYfZXkU_XuzXaQ-E_8oYyBDCYPK+AwP+7B0im_M3tdOj+iZA@mail.gmail.com>
 <CALm0H54B3jCGJzv+x=Oy5rwPWmpCjCzNuh8Bg4ZThhpragKbFA@mail.gmail.com>
From: Robert Muir <rcmuir@gmail.com>
Date: Sat, 7 Sep 2013 08:39:31 -0400
Message-ID: 
 <CAOdYfZV8Za_moxbJA1kkDQixaAs1PUppT+dgtGYFc4sa1vwCqg@mail.gmail.com>
Subject: Re: PositionLengthAttribute
To: java-user <java-user@lucene.apache.org>
Content-Type: text/plain; charset=UTF-8

On Sat, Sep 7, 2013 at 7:44 AM, Benson Margulies <benson@basistech.com> wrote:
> In Japanese, compounds are just decompositions of the input string. In
> other languages, compounds can manufacture entire tokens from thin
> air. In those cases, it's something of a question how to decide on the
> offsets. I think that you're right, eventually, insofar as there's
> some offset in the original that might as well be blamed for any given
> component.
>

Why change the offsets then? Offsets are for highlighting. Let the
whole compound be highlighted when its a match in search results. Its
transparent and totally accurate as to what is happening: this is why
we do highlighting, to aid the user can make a relevance assessment
about the document, not to try to assist the end user to debug the
analysis chain or anything like that.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org