Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@lucene.apache.org
Received-SPF: pass (nike.apache.org: domain of dmsmith555@gmail.com designates
 74.125.83.48 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=subject:mime-version:content-type:from:in-reply-to:date:cc
         :content-transfer-encoding:message-id:references:to:x-mailer;
        b=j6Rwy674IAbS2Al7NoXv/eouQULBy9aaQHjALkPh/yx8AcgQr8YZdeeccrXwVQsVHr
         OPI2ETrfNan4jtyHVk1Eg5UUZDozmRwm5c9sOkC8MCnQ5wtwsLzar6qFmEfCBr+pbKwy
         b4QONJA3Xeetxs9A8GXi9PB5Fy/M9v5/1y9SU=
Subject: Re: inconsistency/performance trap of empty terms
Mime-Version: 1.0 (Apple Message framework v1081)
Content-Type: text/plain; charset=us-ascii
From: DM Smith <dmsmith555@gmail.com>
In-Reply-To: <AANLkTikhnSo5P_chZe=-XZgEBDW+C8Yz0w1ai7V4j6_p@mail.gmail.com>
Date: Sat, 30 Oct 2010 12:51:08 -0400
Cc: yonik@lucidimagination.com
Content-Transfer-Encoding: quoted-printable
Message-Id: <34F941D8-4CFF-4106-A102-9EA5E272667B@gmail.com>
References: <AANLkTim6MjccRDwp8DT-tTbG9JLE74A0GG8e48i0b=hz@mail.gmail.com>
 <alpine.DEB.1.10.1010281653220.28331@radix.cryptio.net>
 <AANLkTimY+rqbGJnAGEwyNP2OfiwhEGuAkYMF5GbY_5Qi@mail.gmail.com>
 <alpine.DEB.1.10.1010291032320.11189@radix.cryptio.net>
 <AANLkTikWg8HEgKz4_zOfZjgFTJj1MKv3dSMVAod-XOhe@mail.gmail.com>
 <AANLkTikS27+hm5V_bkm13TBSeA_H-+K=b5S=HtyrsWdt@mail.gmail.com>
 <AANLkTimf-muTMb4H16cKkDXDeTb_fEpG5ReGRDKLj54R@mail.gmail.com>
 <AANLkTi=fgMAFcLeLLtLUeBN33ySBntYGx=rFLp_-QZZx@mail.gmail.com>
 <AANLkTi=kLzsPEoJLN1rtxpxZmgFT7r8U8kGyWnhewQyW@mail.gmail.com>
 <AANLkTi=eqwjJbouBmTcF9AaX_d8bpRKpu_xgo+qUr-DH@mail.gmail.com>
 <AANLkTikDNhoMMAQ=c3aM9FXkaAMqsHHaoSN5dt1tfXXm@mail.gmail.com>
 <000e01cb7841$aa7dce50$ff796af0$@thetaphi.de>
 <AANLkTi=+3cJ2yMqn75YpYmi-Xn3VL98p5WwrSg5foeie@mail.gmail.com>
 <AANLkTikSanHMw8ueLBEaJoXxqJzR=cXmJnfZ1gLWxWhq@mail.gmail.com>
 <AANLkTikWUNp_u84wkT3mdu46L3YOfvoGh+Tvmdu=adC4@mail.gmail.com>
 <AANLkTikhnSo5P_chZe=-XZgEBDW+C8Yz0w1ai7V4j6_p@mail.gmail.com>
To: dev@lucene.apache.org


On Oct 30, 2010, at 12:00 PM, Robert Muir wrote:

> On Sat, Oct 30, 2010 at 11:54 AM, Yonik Seeley
> <yonik@lucidimagination.com> wrote:
>> If it's only for the QP, a simple method that one could override =
would suffice:
>> QueryParser.getTokenStream(String field, String value)
>>=20
>> If it's not just for the QP, then we have Analyzer (as you've pointed =
out).
>>=20
>>=20
>=20
> right, but if we did this, it makes some things tricky (e.g. the user
> has to manage reset(Reader)/reset() tokenStream reuse).
> A tokenizer/tokenfilter they are using could be "heavy" in terms of
> initialization cost.

Maybe I'm missing something here. Can't there be an empty analyzer that =
takes a TokenStream as an argument to its constructor and wraps it with =
all the reuse goodness?

>=20
> anyway, i'd like to get rid of Analyzer just as much as anyone, but
> making the API difficult/fragile/non-performant isn't a good way


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org