Mailing-List: contact lucy-dev-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: lucy-dev@incubator.apache.org
Received-SPF: pass (athena.apache.org: domain of dmarkham@gmail.com designates
 74.125.83.175 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=from:mime-version:content-type:subject:date:in-reply-to:to
         :references:message-id:x-mailer;
        b=GUv8xQ1IFMLniZQwR7otsajVhJyEPe8/uNqK1LPwUnhrNcni8R/bobyqrOruo6MUV6
         bqZSR25ydT/l2St0tLWRzD0XPByu8JclqXSgZ2FuAbOrHO2PYPAp0YfWPCYY64oNm1Ue
         Q08wBVVxh6GcHYnFX4wR8sYbKqTX4vPMpMJgY=
From: Dan Markham <dmarkham@gmail.com>
Mime-Version: 1.0 (Apple Message framework v1084)
Content-Type: multipart/alternative; boundary=Apple-Mail-1--201452261
Date: Thu, 23 Jun 2011 01:37:09 -0700
In-Reply-To: <4E02A2B9.2020503@peknet.com>
To: lucy-dev@incubator.apache.org
References: <4E002F53.3080507@peknet.com>
 <20110621181520.GA22200@rectangular.com>
 <20110623015117.GA6816@rectangular.com> <4E02A2B9.2020503@peknet.com>
Message-Id: <AD3EE35E-1A29-4D40-8AA5-1660C3CA67A7@gmail.com>
Subject: Re: [lucy-dev] RangeQuery and multi-value fields

--Apple-Mail-1--201452261
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=us-ascii

The only thing that is a bit different is we encode (bases62) the =
numbers of xxxx's in the last digit mainly so the terms are smaller in =
length.


my @foo =3D  encode_trie(100000);
print Dumper(\@foo);

The output would look like this:
$VAR1 =3D [
          '1a',                     ## 1xxxxxxxxxx
          '129',                  ##  12xxxxxxxxx
          '1208',        =20
          '12007',
          '120026',
          '1200205',
          '12002014',
          '120020113',
          '1200201122',
          '12002011201',
          '120020112010'   ## the exact match for  base 3  @ 100000
        ];


So you really only use encode_trie(int) to build the terms to index and =20=

query_trie( minint, maxint ) for search  terms at query time.


few things i'm pretty sure need some love are:
 1.   encode() and qery_trie() are hard coded for base3.
 2.  If the length if your trie gets longer than 62 chars the cute disk =
saving trick above will surely not work.


enjoy,
-Dan


On Jun 22, 2011, at 7:19 PM, Peter Karman wrote:

> Marvin Humphrey wrote on 6/22/11 8:51 PM:
>>> On Tue, Jun 21, 2011 at 12:42:43AM -0500, Peter Karman wrote:
>>>> I want to override the behavior of the RangeQuery class to support =
my pseudo
>>>> multi-value fields, which I achieve by concatenating values with =
the \x03 byte.
>>=20
>> OK, there's another option which has suddenly become more attractive. =
:)  My
>> Eventful colleague Dan Markham has submitted a trie implementation =
that can be
>> used for generating numeric ranges:
>>=20
>>    https://issues.apache.org/jira/browse/LUCY-159
>>=20
>> It is to some degree based on the algorithm used by Lucene's =
NumericRangeQuery:
>>=20
>>    http://s.apache.org/QOx
>>=20
>=20
> Thanks to both you and Dan for this contribution!
>=20
> I'll have a look at the code and the docs and see if it feels workable =
for my
> particular need. In any case, I think it's great to see contributions =
like
> these, expanding the Lucy ecosystem.
>=20
>=20
> --=20
> Peter Karman  .  http://peknet.com/  .  peter@peknet.com


--Apple-Mail-1--201452261--