Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (nike.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.com;
  h=Message-ID:X-YMail-OSG:Received:X-Mailer:References:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type;
  b=lSv0zDZ7vP8igrqkG93iK9DANam7+73rKABJqyfEipngDiRpN2a8LTn2bgEX+T2BxHViqTpCew/Cvd69wzeFNBtLy56m9kiSnSBCVTJKL/MPgQDdNZwxeel8w5B7KqY9nQ0Ul5WULDFyIjg1XGDa46RMiWfEEBa/Z0JhxfGezQ8=;
Message-ID: <905474.12673.qm@web50306.mail.re2.yahoo.com>
References: <ba012a2b1001191958r4551d5bfpadd14ef368758f6a@mail.gmail.com>
 <672105.67952.qm@web50307.mail.re2.yahoo.com>
 <AC97BD92CC214408BAB25A90F849C44D@sv.us.sonicwall.com>
Date: Tue, 19 Jan 2010 22:24:54 -0800 (PST)
From: Otis Gospodnetic <otis_gospodnetic@yahoo.com>
Subject: Re: Lucene as a primary datastore
To: java-user@lucene.apache.org
In-Reply-To: <AC97BD92CC214408BAB25A90F849C44D@sv.us.sonicwall.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii

Have you seen the "Hot Backups with Lucene" paper available via http://www.manning.com/hatcher3/ ?

 
Otis
--
Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch


----- Original Message ----
> From: Ganesh <emailgane@yahoo.co.in>
> To: java-user@lucene.apache.org
> Sent: Wed, January 20, 2010 1:13:21 AM
> Subject: Re: Lucene as a primary datastore
> 
> We have data in compound files and we use Lucene as primary database. Its 
> working great and much faster with millions of records. The only issue, I face 
> is with sorting. Lucene sorting consumes good amount of memory. I don't know 
> much about the MySQL/PostgreSQL database, and how they behave with millions of 
> records but i guess their sorting memory consumption would be less.  
> 
> It would be great, If Lucene has the ability to do backups / replication. I 
> don't know how to modify/use the solr script.  
> 
> Regards
> Ganesh
> 
> 
> ----- Original Message ----- 
> From: "Otis Gospodnetic" 
> To: ; 
> Sent: Wednesday, January 20, 2010 10:45 AM
> Subject: Re: Lucene as a primary datastore
> 
> 
> > You are not alone, Guido.  It's a good question.  In my experience, Lucene is 
> as stable as MySQL/PostgreSQL in terms of its ability to hold your data and not 
> corrupt it.  Of course, even with the most expensive databases, you'd want to 
> make backups.  The same goes with Lucene.  Nowadays, one way people make 
> "backups" is via replication. :)  Solr users thus often get backups for free, as 
> do people who put copies of their data on file systems like HDFS, which tend to 
> have replication turned on.
> > 
> > Otis
> > --
> > Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch
> > 
> > 
> > 
> > ----- Original Message ----
> >> From: Guido Bartolucci 
> >> To: java-user@lucene.apache.org
> >> Sent: Tue, January 19, 2010 10:58:36 PM
> >> Subject: Lucene as a primary datastore
> >> 
> >> I know that the primary use case for Lucene is as an index of data
> >> that can be reconstructed (e.g., from a relational database or from
> >> spidering your corporate intranet).
> >> 
> >> But, I'm curious if anyone uses Lucene as their primary datastore for
> >> their gold data. Is it good enough?
> >> 
> >> Would anyone consider (or do people already) store data in Lucene
> >> that, if it was lost, would destroy their business? And no, I'm not
> >> suggesting that you don't back up this data, I'm just curious if there
> >> are problems with using Lucene in this way. Are there subtle
> >> corruptions that might show up in Lucene that wouldn't show up in
> >> Oracle or MySQL?
> >> 
> >> I'm considering using Lucene in this way but I haven't been able to
> >> find any documentation describing this use case. Are there any studies
> >> of Lucene vs MySQL running for N years comparing the corruptions and
> >> recovery times?
> >> 
> >> Am I just ignorant and scared of Lucene and too trusting of Oracle and MySQL?
> >> 
> >> Thanks.
> >> 
> >> -guido.
> >> 
> >> (BTW, I did find a similar question asked back in 2007 in the archives
> >> but it doesn't really answer my question)
> >> 
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> >> For additional commands, e-mail: java-user-help@lucene.apache.org
> > 
> > 
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> > For additional commands, e-mail: java-user-help@lucene.apache.org
> >
> Send instant messages to your online friends http://in.messenger.yahoo.com
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org