Mailing-List: contact general-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: general@lucene.apache.org
Received-SPF: error (nike.apache.org: local policy)
From: "Fuad Efendi" <fuad@efendi.ca>
To: <general@lucene.apache.org>
References: 
 <CAHCi+QXnZfgd7+5dBion6zdQccQnA9QpWUq5=RnpW2KGbRm=fA@mail.gmail.com>
 <1434394561.2590356.296201153.2C09E40F@webmail.messagingengine.com>
 <CAJwFCa1+6oPHNTJZuUa7nfBfcxSVfzAvVyknt-r0LG_=og6qag@mail.gmail.com>
In-Reply-To: 
 <CAJwFCa1+6oPHNTJZuUa7nfBfcxSVfzAvVyknt-r0LG_=og6qag@mail.gmail.com>
Subject: RE: Lucene vs Solr Indexing Speed on Sample data Issue!!!
Date: Mon, 15 Jun 2015 16:17:47 -0400
Message-ID: <001a01d0a7a8$5895eff0$09c1cfd0$@efendi.ca>
MIME-Version: 1.0
Content-Type: text/plain;
	charset="utf-8"
Content-Transfer-Encoding: quoted-printable
Thread-Index: AQGzxs9OX+O7ujPMr8ym38MWIgBTjQHuNZz6Akqjceydxfqz8A==
Content-Language: en-ca

>From my experience, "high throughput" example:

Using single-thread SolrJ client, I can index (for example) 1000 =
documents per second. And this is maximum "speed".
Using 12 Threads, I can index 12000 documents per second, just because =
we have 8-core SOLR, and 75% of processing is CPU-bound.


You can do it with SOLR + SolrJ easily; with Lucene you will need much =
more development efforts, but it is the same.


Thanks,


http://www.tokenizer.ca

-----Original Message-----
From: Ted Dunning [mailto:ted.dunning@gmail.com]=20
Sent: June-15-15 3:17 PM
To: general@lucene.apache.org
Subject: Re: Lucene vs Solr Indexing Speed on Sample data Issue!!!

And what does high throughput actually mean in terms of number of =
documents per second and bytes (or terms) per document?


On Mon, Jun 15, 2015 at 11:56 AM, Upayavira <uv@odoko.co.uk> wrote:

> Please post the original question here, so that everything people need =

> to review your question is included within this thread!
>
> Oh, and for a high-throughput system, 8Gb RAM doesn't sound like much. =

> A Lucene index, whether inside Solr or not, benefits from a lot of =
RAM.
>
> Thanks!
>
> Upayavira
>
> On Mon, Jun 15, 2015, at 05:19 AM, Argho Chatterjee wrote:
> > Hello Everyone,
> >
> > I had posted a question on stackoverflow.com after performing a few=20
> > POCs
> >
> > My hadrware consist of a single i-3 intel processor (4 CPU as per=20
> > "dxdiag"
> > on run ), 8GB Ram, Laptop machine.
> >
> > My Question Link :
> >
> http://stackoverflow.com/questions/30823314/lucene-vs-solr-indexning-s
> peed-for-sampe-data
> >
> > but no one could solve it as of now..
> > I hope the question I posted is undertandable.
> >
> > Please if anyone could help me out with the indexing speed of Solr=20
> > (way
> > slower) vs Lucene (way faster)..
> >
> > I am trying to build a module for real time indexing and querying,=20
> > and the traffic is high, POC pass with Lucene for handling High=20
> > Traffic for Indexing, for Solr It is not able to do so..
> >
> > Again My Machine Spec :
> > HP, intel core i3, 8GB ram, TB HDD.
> >
> > Please let me know if there is a problem with Solr or am I doing=20
> > anything wrong.
> >
> > Thanks
> > Argho
>