lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ramprasad Padmanabhan <ramprasad...@gmail.com>
Subject Re: Can I use multiple cores
Date Tue, 12 Aug 2014 09:50:39 GMT
Are there documented benchmarks with number of cores
As of now I just have a test bed.


We have 150 million records ( will go up to 1000 M )  , distributed in 400
cores.
A single machine 16GB RAM + 16 cores  search  is working "fine"

But I still am not sure will this work fine in production
Obviously I can always add more nodes to solr, but I need to justify how
much I need.





On 12 August 2014 12:48, Harshvardhan Ojha <ojha.harshvardhan@gmail.com>
wrote:

> I think this question is more aimed at design and performance of large
> number of cores.
> Also solr is designed to handle multiple cores effectively, however it
> would be interesting to know If you have observed any performance problem
> with growing number of cores, with number of nodes and solr version.
>
> Regards
> Harshvardhan Ojha
>
>
> On Tue, Aug 12, 2014 at 12:33 PM, Anshum Gupta <anshum@anshumgupta.net>
> wrote:
>
> > Hi Ramprasad,
> >
> > You can certainly have a system with hundreds of cores. I know of more
> than
> > a few people who have done that successfully in their setups.
> >
> > At the same time, I'd also recommend to you to have a look at SolrCloud.
> > SolrCloud takes away the operational pains like replication/recovery etc.
> > to a major extent. I don't know about your security requirements and hard
> > bounds on that front but look at routing in SolrCloud to also figure out
> > multi-tenancy implementation here:
> > * SolrCloud Document Routing by Joel:
> > http://searchhub.org/2013/06/13/solr-cloud-document-routing/
> > * Multi-level composite-id routing in SolrCloud:
> > http://searchhub.org/2014/01/06/10590/
> >
> >
> >
> > On Mon, Aug 11, 2014 at 11:40 PM, Ramprasad Padmanabhan <
> > ramprasad.ap@gmail.com> wrote:
> >
> > > I need to store in SOLR all data of my clients mailing activitiy
> > >
> > > The data contains meta data like From;To:Date;Time:Subject etc
> > >
> > > I would easily have 1000 Million records every 2 months.
> > >
> > > What I am currently doing is creating cores per client. So I have 400
> > cores
> > > already.
> > >
> > > Is this a good idea to do ?
> > >
> > > What is the general practice for creating cores
> > >
> >
> >
> >
> > --
> >
> > Anshum Gupta
> > http://www.anshumgupta.net
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message