Mailing-List: contact java-dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-dev@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of ning.li.li@gmail.com
 designates 64.233.166.177 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:references;
        b=TfDx7aHVuKGE7P4Rm8iSachNHFee7NkLsMaXcB6ncb3wGDRkFighgY8lUy4uBZuqtCyVzjnTjP05x3Tgwko6JuQyrYeg4KLE1u4WqNdRS4Vjq4JRLbSG0iUsFiLDnVpaXVa9w6pvQyO7LFop81trAochazZ0NalPjIhJRb8fa+0=
Message-ID: <c7b302c50802061617p51b9f185h82b63cd252ec6caa@mail.gmail.com>
Date: Wed, 6 Feb 2008 16:17:52 -0800
From: "Ning Li" <ning.li.li@gmail.com>
To: solr-user@lucene.apache.org
Subject: Re: Lucene-based Distributed Index Leveraging Hadoop
Cc: general@lucene.apache.org, java-dev@lucene.apache.org
In-Reply-To: <47AA1F1E.5030603@holsman.net>
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_Part_14969_33109202.1202343472777"
References: <c7b302c50802061057w508329d7p7d82b73cd61ce3ce@mail.gmail.com>
	 <3B5AF75FB405D64B8089C6863C52AB2E2A939D@NJ-E2K3-MBOX01.cnet.cnwk>
	 <47AA1F1E.5030603@holsman.net>

------=_Part_14969_33109202.1202343472777
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

One main focus is to provide fault-tolerance in this distributed index
system. Correct me if I'm wrong, I think SOLR-303 is focusing on merging
results from multiple shards right now. We'd like to start an open source
project for a fault-tolerant distributed index system (or join if one
already exists) if there is enough interest. Making Solr work on top of such
a system could be an important goal and SOLR-303 is a big part of it in that
case.

I should have made it clear that disjoint data sets are not a requirement of
the system.


On Feb 6, 2008 12:57 PM, Ian Holsman <lists@holsman.net> wrote:

> Hi.
> AOL has a couple of projects going on in the lucene/hadoop/solr space,
> and we will be pushing more stuff out as we can. We don't have anything
> going with solr over hadoop at the moment.
>
> I'm not sure if this would be better than what SOLR-303 does, but you
> should have a look at the work being done there.
>
> One of the things you mentioned is that the data sets are disjoint.
> SOLR-303 doesn't require this, and allows us to have a document stored
> in multiple shards (with different caching/update characteristics).
>
>

------=_Part_14969_33109202.1202343472777--