lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Otis Gospodnetic <otis_gospodne...@yahoo.com>
Subject Re: Lucene 2.9.0 Near Real Time Indexing and lock timeouts
Date Wed, 13 Jan 2010 04:13:01 GMT
John,

Yes, you should get 2.9.0 or 3.0.0, their indexing is faster.  Still, even with 2.4.0 you
shouldn't run into problems if you are really using just 1 IndexWriter.  Still, I'd try upgrading
first.  Oh, and java-user is the place to ask.

Otis
--
Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch



----- Original Message ----
> From: jchang <jchangkihatest@gmail.com>
> To: java-dev@lucene.apache.org
> Sent: Tue, January 12, 2010 6:27:12 PM
> Subject: Lucene 2.9.0 Near Real Time Indexing and lock timeouts
> 
> 
> Hello,
> 
> I am using Lucene 2.4.0 and am  getting
> org.apache.lucene.store.LockObtainFailedException's when I have a backed up
> queue of items to index (with multiple concurrent writers).  Of course, if I
> throttle all my writer threads to 1, I don't get the exception, but I'm
> hoping to write faster than that.  Also, when I have multiple index writer
> threads, it's not that much faster anyhow, I assume because the bottle neck
> is on one the index file.
> 
> Will 2.9.0 help?  I've read about the near real time indexing.  Will this
> allow me to have:
> 1) Multiple threads indexing items all at the same time, achieving
> appreciably faster throughput than only one thread?
> 2) And avoid getting org.apache.lucene.store.LockObtainFailedException's?
> 3) Have this all near real time?  
> 
> And generally, if anybody has any advice on high-throughput indexing with
> Lucene and what kind of numbers I can acheive, I'd welcome the feedback.
> 
> Thanks,
> John
> -- 
> View this message in context: 
> http://old.nabble.com/Lucene-2.9.0-Near-Real-Time-Indexing-and-lock-timeouts-tp27136743p27136743.html
> Sent from the Lucene - Java Developer mailing list archive at Nabble.com.
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-dev-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message