Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of anshumg@gmail.com designates
 209.85.217.13 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:to:subject:in-reply-to:mime-version
         :content-type:references;
        b=bzeoxDI9vvwecrMGwaYKhBaVWwOf5pzp/H2zK7BEs3tO3059/GATzBMb8lHfwZNAos
         daM5JlaxwWwAXC4XjhT7mm3Jc9hTyAn/l0GkkdITDPKuZQ/OJl8g0/xBLaVtPxmxeiYc
         utYX+Ii5kzcyUBfb+FWwgsHeOEsl8b2DFIXA0=
Message-ID: <867513fe0810030918m1b3ecd64k98ed01214caaaa5d@mail.gmail.com>
Date: Fri, 3 Oct 2008 21:48:57 +0530
From: Anshum <anshumg@gmail.com>
To: java-user@lucene.apache.org
Subject: Re: Single searcher vs Multi Searcher
In-Reply-To: <02ed01c9253a$c5ecef60$330bc30a@sv.us.sonicwall.com>
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_Part_21884_20487011.1223050737452"
References: <02ed01c9253a$c5ecef60$330bc30a@sv.us.sonicwall.com>

------=_Part_21884_20487011.1223050737452
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

Hi Ganesh,

I have experimented with sharded indexes and they seem to benefit me(atleast
in my case). I would like to know a few things before I answer your
question:
1. Do you have a reasonable criteria ( a calculated one) to shard the
indexes?
2. How do you plan to split the index? Is it going to be document based
(which I guess it should be as otherwise you would have to build a complete
distributed system)
3. Do you plan to put your indexes on the RAM or on (physically) seperate
HDDs?

Though all said and done, sharded indexes are a good approach, if done the
right way.
--
Anshum Gupta
Naukri Labs!
http://ai-cafe.blogspot.com

The facts expressed here belong to everybody, the opinions to me. The
distinction is yours to draw............


On Fri, Oct 3, 2008 at 3:01 PM, Ganesh <emailgane@yahoo.co.in> wrote:

> Hello all,
>
> My indexing is growing by 1 million records per day and the memory
> consumption of the searcher object is quite high.
>
> There are different opinion in the groups. Few suggest to use single
> database and few to use sharding. My Database has 10 million records now and
> it might go till 30 million or more. I plan to shard the index. but
> Multisearcher will give me benifit.
>
> Regards
> Ganesh
>
>
> Send instant messages to your online friends http://in.messenger.yahoo.com
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

------=_Part_21884_20487011.1223050737452--