Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of willjohnsonsearch@gmail.com
 designates 74.125.83.48 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=VclV2XaoKJmfC4GAxnxJ7ORsYB/7b3vkfED9f0BlT0wlLB+TvURFCkff0nTFt8tgUA
         aNYK173Ru1aI5r7FeV1n3KUxnlYl2i9+mT8O5KqLhkYF8Koc8w7khkFkDqYCntPUveQ4
         XayVIzlpH9hww69JRnWqEopkDVw/lBv/NIq8g=
MIME-Version: 1.0
In-Reply-To: <s2v500e4a1e1004010625m20de81bdu8d3c0330afe8a959@mail.gmail.com>
References: <j2n962c93f61003311817mb0916942r662787cab6b3af28@mail.gmail.com>
	 <h2l500e4a1e1003311823q20e6a91bwe4265bf863a1eff6@mail.gmail.com>
	 <u2y962c93f61004010444t7641c919u3159d610d4be9299@mail.gmail.com>
	 <k2r500e4a1e1004010511z74cb4c66ofd4be60f4f73294f@mail.gmail.com>
	 <214FF1B5E37DC84D9968F0F82FBB112508D1AB06@AUGEXCH.ghsinc.com>
	 <s2v500e4a1e1004010625m20de81bdu8d3c0330afe8a959@mail.gmail.com>
Date: Thu, 1 Apr 2010 09:43:48 -0400
Message-ID: <x2i3922582e1004010643hd2a4f589za40fa9d2b39f9e29@mail.gmail.com>
Subject: Re: Lucene Challenge - sum, count, avg, etc.
From: Will Johnson <willjohnsonsearch@gmail.com>
To: java-user@lucene.apache.org
Content-Type: multipart/alternative; boundary=000e0cd253e6662fbc04832d0d69

--000e0cd253e6662fbc04832d0d69
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

Hi Michel,


You can do all of this with Lucene however not with a standard index/query
operators.  At Attivio we have a custom Lucene index structure + custom
query operators that support relational joins across records in an index.  =
You
can write the queries in our standard query language or run actual SQL.  Al=
l
of this is done without pre-computing or flattening records as that prevent=
s
you from having query flexibility at runtime, ie what happens when you want
to know something that isn=92t pre-computed/pre-flattened?


If you look at the demo at the bottom of this page
http://www.attivio.com/active-intelligence/aie-demo.html  you can see how w=
e
index and query against both news articles and baseball statistics from a
relational database.  For example you can do something like this with the
baseball data:


select sum(RBI), teamID, yearID

from master m join batting b

on m."playerID" =3D b.playerID

where b.yearID > '2004'

group by yearID,teamID

order by yearID,teamID


We support min, max, avg and a number of other aggregate functions along
with true full-text search.  Another article you might check out is here:
http://www.attivio.com/blog/55-industry-insights/507-can-a-search-engine-re=
place-a-relational-database.html
.  So far we're getting some pretty good results competing with databases
and data warehouses on raw performance (at customer sites) even without the
full text search capabilities mixed in.  Once you start adding in 'fuzzy'
joins, relevancy, proximity and all the other boolean query logic, we start
to pull ahead even further.


If you want to learn more drop me a line.  We'll be demonstrating all this
stuff (and more) at Enterprise Search Summit (ESS) in New York this coming
May.


- will@attivio.com

--000e0cd253e6662fbc04832d0d69--