Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-user@lucene.apache.org
Received-SPF: pass (nike.apache.org: domain of sarowe@gmail.com designates
 209.85.223.170 as permitted sender)
Content-Type: text/plain; charset=iso-8859-1
Mime-Version: 1.0 (Mac OS X Mail 6.3 \(1503\))
Subject: Re: Is there an EdgeSingleFilter already?
From: Steve Rowe <sarowe@gmail.com>
In-Reply-To: 
 <CAHh4nDdEWxNGjwXxbnfJriO1NyLXFwH40UB9pyhiyMGYLWBTyw@mail.gmail.com>
Date: Sun, 17 Mar 2013 13:27:19 -0400
Content-Transfer-Encoding: quoted-printable
Message-Id: <A2CD3A47-9CE0-4380-86B0-9FFEEE7C8990@gmail.com>
References: 
 <CAHh4nDdzWUC1CaUoZJn6P5Yvd9mEh8MAH3L5kjCMnXiwiXijkQ@mail.gmail.com>
 <BCA8F7B7-700F-48F1-89D8-F27930539D88@gmail.com>
 <CAHh4nDcOmShPykG5iA8RmWwcL7qa4_tBCO7nzYKTFUqndZBzLQ@mail.gmail.com>
 <CAHh4nDcQ4iutqXE1yemprOFxph-XD+iJe1LY0os=XUG+PJF2oQ@mail.gmail.com>
 <E5B35494-94A2-4C99-A176-7B1331424B7F@gmail.com>
 <CAHh4nDdEWxNGjwXxbnfJriO1NyLXFwH40UB9pyhiyMGYLWBTyw@mail.gmail.com>
To: solr-user@lucene.apache.org

Hi xavier,

Cool, thanks for the feedback, I'll commit later today (unless somebody =
objects), so it will be part of the Lucene/Solr 4.3 release.

Steve

On Mar 17, 2013, at 1:21 PM, xavier jmlucjav <jmlucjav@gmail.com> wrote:

> Steve, worked like a charm.
> thanks!
>=20
>=20
> On Sun, Mar 17, 2013 at 7:37 AM, Steve Rowe <sarowe@gmail.com> wrote:
>=20
>> See https://issues.apache.org/jira/browse/LUCENE-4843
>>=20
>> Let me know if it works for you.
>>=20
>> Steve
>>=20
>> On Mar 16, 2013, at 5:35 PM, xavier jmlucjav <jmlucjav@gmail.com> =
wrote:
>>=20
>>> I read too fast your reply, so I thought you meant configuring the
>>> LimitTokenPositionFilter. I see you mean I have to write one, ok...
>>>=20
>>>=20
>>>=20
>>> On Sat, Mar 16, 2013 at 10:33 PM, xavier jmlucjav =
<jmlucjav@gmail.com
>>> wrote:
>>>=20
>>>> Steve,
>>>>=20
>>>> Yes, I want only "one", "one two", and "one two three", but nothing
>> else.
>>>> Cool if this can be achieved without java code even better, I'll =
check
>> that
>>>> filter.
>>>>=20
>>>> I need this for building a field used for suggestions, the user
>>>> specifically wants no match only from the edge.
>>>>=20
>>>> thanks!
>>>>=20
>>>> On Sat, Mar 16, 2013 at 10:22 PM, Steve Rowe <sarowe@gmail.com> =
wrote:
>>>>=20
>>>>> Hi xavier,
>>>>>=20
>>>>> It's not clear to me what you want.  Is the "edge" you're =
referring to
>>>>> the beginning of a field? E.g. raw text "one two three four" with
>>>>> EdgeShingleFilter configured to produce unigrams, bigrams and =
trigams
>> would
>>>>> produce "one", "one two", and "one two three", but nothing else?
>>>>>=20
>>>>> If so, I suspect writing a LimitTokenPositionFilter (which would =
stop
>>>>> emitting tokens after the token position exceeds a specified =
limit)
>> would
>>>>> be better, rather than subclassing ShingleFilter.  You could use
>>>>> LimitTokenCountFilter as a model, especially its =
"comsumeAllTokens"
>> option.
>>>>> I think this would make a nice addition to Lucene.
>>>>>=20
>>>>> Also, what do you plan to use this for?
>>>>>=20
>>>>> Steve
>>>>>=20
>>>>> On Mar 16, 2013, at 5:02 PM, xavier jmlucjav <jmlucjav@gmail.com>
>> wrote:
>>>>>> Hi,
>>>>>>=20
>>>>>> I need to use shingles but only keep the ones that start from the
>> edge.
>>>>>>=20
>>>>>> I want to confirm there is no way to get this feature without
>>>>> subclassing
>>>>>> ShingleFilter, cause I thought someone would have already =
encountered
>>>>> this
>>>>>> use case....
>>>>>>=20
>>>>>> thanks
>>>>>> xavier
>>>>>=20
>>>>>=20
>>>>=20
>>=20
>>=20