Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (nike.apache.org: domain of bimargulies@gmail.com
 designates 209.85.214.177 as permitted sender)
MIME-Version: 1.0
Date: Fri, 24 Oct 2014 16:42:40 -0400
Message-ID: 
 <CALhtWkdfeNa=GrP3WJ6z_K_pXZpE8abPveJfMyB-==fP3JOh-g@mail.gmail.com>
Subject: A really hairy token graph case
From: Benson Margulies <bimargulies@gmail.com>
To: "java-user@lucene.apache.org" <java-user@lucene.apache.org>
Content-Type: text/plain; charset=UTF-8

Consider a case where we have a token which can be subdivided in
several ways. This can happen in German. We'd like to represent this
with positionIncrement/positionLength, but it does not seem possible.

Once the position has moved out from one set of 'subtokens', we see no
way to move it back for the second set of alternatives.

Is this something that was considered?

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org