lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ganesh" <emailg...@yahoo.co.in>
Subject Re: Lucene as a primary datastore
Date Wed, 20 Jan 2010 07:27:11 GMT
Thanks Otis. The download link sent via email has file called cemail. There is no extn. I tried
with html,pdf but it is not opening properly.

Regards
Ganesh

----- Original Message ----- 
From: "Otis Gospodnetic" <otis_gospodnetic@yahoo.com>
To: <java-user@lucene.apache.org>
Sent: Wednesday, January 20, 2010 11:54 AM
Subject: Re: Lucene as a primary datastore


> Have you seen the "Hot Backups with Lucene" paper available via http://www.manning.com/hatcher3/
?
> 
> 
> Otis
> --
> Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch
> 
> 
> 
> ----- Original Message ----
>> From: Ganesh <emailgane@yahoo.co.in>
>> To: java-user@lucene.apache.org
>> Sent: Wed, January 20, 2010 1:13:21 AM
>> Subject: Re: Lucene as a primary datastore
>> 
>> We have data in compound files and we use Lucene as primary database. Its 
>> working great and much faster with millions of records. The only issue, I face 
>> is with sorting. Lucene sorting consumes good amount of memory. I don't know 
>> much about the MySQL/PostgreSQL database, and how they behave with millions of 
>> records but i guess their sorting memory consumption would be less.  
>> 
>> It would be great, If Lucene has the ability to do backups / replication. I 
>> don't know how to modify/use the solr script.  
>> 
>> Regards
>> Ganesh
>> 
>> 
>> ----- Original Message ----- 
>> From: "Otis Gospodnetic" 
>> To: ; 
>> Sent: Wednesday, January 20, 2010 10:45 AM
>> Subject: Re: Lucene as a primary datastore
>> 
>> 
>> > You are not alone, Guido.  It's a good question.  In my experience, Lucene is

>> as stable as MySQL/PostgreSQL in terms of its ability to hold your data and not 
>> corrupt it.  Of course, even with the most expensive databases, you'd want to 
>> make backups.  The same goes with Lucene.  Nowadays, one way people make 
>> "backups" is via replication. :)  Solr users thus often get backups for free, as

>> do people who put copies of their data on file systems like HDFS, which tend to 
>> have replication turned on.
>> > 
>> > Otis
>> > --
>> > Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch
>> > 
>> > 
>> > 
>> > ----- Original Message ----
>> >> From: Guido Bartolucci 
>> >> To: java-user@lucene.apache.org
>> >> Sent: Tue, January 19, 2010 10:58:36 PM
>> >> Subject: Lucene as a primary datastore
>> >> 
>> >> I know that the primary use case for Lucene is as an index of data
>> >> that can be reconstructed (e.g., from a relational database or from
>> >> spidering your corporate intranet).
>> >> 
>> >> But, I'm curious if anyone uses Lucene as their primary datastore for
>> >> their gold data. Is it good enough?
>> >> 
>> >> Would anyone consider (or do people already) store data in Lucene
>> >> that, if it was lost, would destroy their business? And no, I'm not
>> >> suggesting that you don't back up this data, I'm just curious if there
>> >> are problems with using Lucene in this way. Are there subtle
>> >> corruptions that might show up in Lucene that wouldn't show up in
>> >> Oracle or MySQL?
>> >> 
>> >> I'm considering using Lucene in this way but I haven't been able to
>> >> find any documentation describing this use case. Are there any studies
>> >> of Lucene vs MySQL running for N years comparing the corruptions and
>> >> recovery times?
>> >> 
>> >> Am I just ignorant and scared of Lucene and too trusting of Oracle and MySQL?
>> >> 
>> >> Thanks.
>> >> 
>> >> -guido.
>> >> 
>> >> (BTW, I did find a similar question asked back in 2007 in the archives
>> >> but it doesn't really answer my question)
>> >> 
>> >> ---------------------------------------------------------------------
>> >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> >> For additional commands, e-mail: java-user-help@lucene.apache.org
>> > 
>> > 
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> > For additional commands, e-mail: java-user-help@lucene.apache.org
>> >
>> Send instant messages to your online friends http://in.messenger.yahoo.com
>> 
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
Send instant messages to your online friends http://in.messenger.yahoo.com 

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message