lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Fuad Efendi" <f...@efendi.ca>
Subject RE: Making lucene indexing multi threaded
Date Mon, 27 Oct 2014 14:56:12 GMT
I believe there were many reports of many-thousands-docs per second in
average.
I experienced similar SOLR speeds many years ago too, with small documents
(512-bytes each)

You can check harddrive performance at first (use SSD, etc...); and second,
check your indexing architecture: is it multithreaded? I used multiple
threads (64-128) from client workstation to submit Solr documents
concurrently to (local / or remote) Solr instance, via SolrJ client.

- Fuad Efendi

-----Original Message-----
From: Jason Wu [mailto:jasonhaowu@gmail.com] 
Sent: October-27-14 10:41 AM
To: java-user@lucene.apache.org
Subject: Re: Making lucene indexing multi threaded

Hi Nischal,

I had similar indexing issue. My lucene indexing took 22 mins for 70 MB
docs. When i debugged the problem, i found out the
indexWriter.addDocument(doc) taking a really long time.

Have you already found the solution about it?

Thank you,
Jason



--
View this message in context:
http://lucene.472066.n3.nabble.com/Making-lucene-indexing-multi-threaded-tp4
087830p4166094.html
Sent from the Lucene - Java Users mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message