lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Cedric Ho" <cedric...@gmail.com>
Subject Re: Distributed Lucene Directory
Date Fri, 01 Feb 2008 01:22:30 GMT
Yes, I am aware of the RemoteSearchable and ParallelSearcher. And I am
doing something similiar now. i.e. split the index on multiple
machines.

But managing such a set of indexes is not trivial. Especially when
need to add redundancies for reliability and update frequently.

I bumped into this a while ago:

http://www.kimchy.org/compasslucene-and-datagrids/

also I've heard there is a Directory implemented for the HDFS but is
unfortunately very slow. which makes me wonder whether this type of
approach is practical (i.e. having good performance, can update index
easily, optimization won't takes too long, etc)

Cedric


On Jan 31, 2008 6:59 PM, Karl Wettin <karl.wettin@gmail.com> wrote:
> 31 jan 2008 kl. 09.42 skrev Cedric Ho:
>
> > I am wondering if there exist any implemenation of
> > org.apache.lucene.store.Directory which can be distributed across
> > multiple machines with comparable performance to a local FSDirectory
> > index, or is such an idea feasible in the first place.
> >
> > By comparable performance I mean a 100G index distributed in 10
> > machines should achieve the same performance as a 10G index on a local
> > FSDirectory.
>
> I never used these things and don't know about their caveats, but
> perhaps a combination of
>
> <http://lucene.apache.org/java/2_3_0/api/org/apache/lucene/search/RemoteSearchable.html
>  >
>
> and
>
> <http://lucene.apache.org/java/2_3_0/api/org/apache/lucene/search/ParallelMultiSearcher.html
>  >
>
> can help you?
>
>
>    karl
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message