Mailing-List: contact java-dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-dev@lucene.apache.org
Received-SPF: pass (athena.apache.org: local policy includes SPF record at
 spf.trusted-forwarder.org)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.co.uk;
  h=X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:MIME-Version:Content-Type:Message-ID;
  b=Hb7xC1AAXMinTdfXkBpo6J5s+M2Sg+s+SgrWcXkdPnp7AqiJ2xcvDpeyx4vpZcmBO+VemdqHm3a/1BWQG8uTzSpof/rtdKew5v6cf8h37VLm1lcxAkH4HBTRBEGdXGCdrJnsZm8vro/CE+cQFKmPQD3iav5/u1njlIEWTgSMFI4=;
Date: Mon, 15 Sep 2008 20:24:08 +0000 (GMT)
From: eks dev <eksdev@yahoo.co.uk>
Subject: Re: docid set compression and boolean docid set operations
To: java-dev@lucene.apache.org
MIME-Version: 1.0
Content-Type: multipart/alternative; boundary="0-916673834-1221510248=:91640"
Message-ID: <415711.91640.qm@web27107.mail.ukl.yahoo.com>

--0-916673834-1221510248=:91640
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable

>    Are you guys interested in helping out on kamikaze?=0A=0Asure, as much=
 as my schedule permits (slow but steady :).=0A  =0Ap4delta should be the r=
ight way to go. My proposal would be to try to make as fast as it goes (Pau=
l's comment about if in decompression loop...) for the simplest case, set o=
f integers (longs?) and make it available as one of Filter implementations =
(fast track commit into lucene and bigger exposure to others that can make =
it better). =0AThe code in kamikaze is probably almost there (not looked in=
to it yet), we just need to make an issue in JIRA  and provide simple patch=
 for basic p4delta functionality and one Filter implementation with a few t=
est cases. So it becomes usefull for the comunity from the very start (also=
 possibility to mix it with Pauls code on DocIdSetIterators...). =0A =0AThi=
s will not bring huge benefit but is definitly usfull option for Filters. T=
he real work then is to make use of it for on disk format and replace parti=
ally VInt encoding for more involved cases I meantoned before like (docId d=
elta, term frequency) pairs in lucene with multilevel skipping information.=
  =0A=0AAs Paul said, small steps :)   =0A  =0Acheers, =0Aeks  =0A=0A=0A   =
   
--0-916673834-1221510248=:91640
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: quoted-printable

<html><head><style type=3D"text/css"><!-- DIV {margin:0px;} --></style></he=
ad><body><div style=3D"font-family:times new roman, new york, times, serif;=
font-size:12pt">&gt;&nbsp;&nbsp;&nbsp; Are you guys interested in helping o=
ut on kamikaze?<div style=3D"font-family: times new roman,new york,times,se=
rif; font-size: 12pt;"><div style=3D"font-family: times new roman,new york,=
times,serif; font-size: 12pt;"><div dir=3D"ltr"><br>sure, as much as my sch=
edule permits (slow but steady :).<br>&nbsp; <br>p4delta should be the righ=
t way to go. My proposal would be to try to make as fast as it goes (Paul's=
 comment about if in decompression loop...) for the simplest case, set of i=
ntegers (longs?) and make it available as one of Filter implementations (fa=
st track commit into lucene and bigger exposure to others that can make it =
better). <br>The code in kamikaze is probably almost there (not looked into=
 it yet), we just need to make an issue in JIRA&nbsp; and provide simple pa=
tch
 for basic p4delta functionality and one Filter implementation with a few t=
est cases. So it becomes usefull for the comunity from the very start (also=
 possibility to mix it with Pauls code on DocIdSetIterators...). <br>&nbsp;=
<br>This will not bring huge benefit but is definitly usfull option for Fil=
ters. The real work then is to make use of it for on disk format and replac=
e partially VInt encoding for more involved cases I meantoned before like (=
docId delta, term frequency) pairs in lucene with multilevel skipping infor=
mation.&nbsp; <br><br>As Paul said, small steps :) &nbsp; <br>=0A&nbsp; <br=
>=0Acheers, <br>eks&nbsp; </div>=0A</div></div></div><br>=0A=0A=0A=0A=0A   =
   </body></html>
--0-916673834-1221510248=:91640--