Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of rcmuir@gmail.com designates
 74.125.82.48 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAHQCg-pTe6+veMk1LUjXxKA0ntHJ6VEPmuTbZHkooDB6BHSPhg@mail.gmail.com>
References: 
 <CAHQCg-pTe6+veMk1LUjXxKA0ntHJ6VEPmuTbZHkooDB6BHSPhg@mail.gmail.com>
From: Robert Muir <rcmuir@gmail.com>
Date: Mon, 12 Dec 2011 07:21:23 -0500
Message-ID: 
 <CAOdYfZU_pe3P-xspsACOhuJwNYTj+=K47uE6a4LYa7=jabB+2A@mail.gmail.com>
Subject: Re: InvalidTokenOffsetsException in conjunction with highlighting and
 ICU folding and edgeNgrams
To: solr-user@lucene.apache.org, me@maxbeutel.de
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

On Mon, Dec 12, 2011 at 5:18 AM, Max <nash12@gmail.com> wrote:

> The end offset remains 11 even after folding and transforming "=C3=A6" to
> "ae", which seems wrong to me.

End offsets refer to the *original text* so this is correct.

What is wrong, is EdgeNGramsFilter. See how it turns that 11 to a 12?

>
> I also stumbled upon https://issues.apache.org/jira/browse/LUCENE-1500
> which seems like a similiar issue.
>
> Is there a workaround for that problem or is the field configuration wron=
g?

For now, don't use EdgeNGrams.

--=20
lucidimagination.com