Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of willjohnsonsearch@gmail.com
 designates 72.14.252.153 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=to:references:in-reply-to:subject:date:message-id:mime-version:content-type:content-transfer-encoding:x-mailer:thread-index:content-language:from;
        b=DwzsNbo59BVXMUDih4u8I1ONQY3Gwnf5+C5y2UqcwhANYyAbnBfdOlEvS/pq6tE6XW9o/Md1cIDslouTV7wapSZul0ToysRhjc/Xq71Xv9E2oCf0B2qQ/RevWCe0D6qRSYySzt6FmHQ1VfFICuNrCbrGpDXCDKzHqVStl8F9LIQ=
To: <java-user@lucene.apache.org>
References: 
 <CE9FC3E386FC2F4ABACDBB9E389C2BA20241C19E@hqmsg01.mcdonaldbradley.local>
 <214FF1B5E37DC84D9968F0F82FBB1125031B7E32@AUGEXCH.ghsinc.com>
In-Reply-To: <214FF1B5E37DC84D9968F0F82FBB1125031B7E32@AUGEXCH.ghsinc.com>
Subject: RE: Why indexing database is necessary? (RE: indexing database)
Date: Tue, 4 Mar 2008 14:18:04 -0500
Message-ID: <000301c87e2c$798b1d00$6ca15700$@com>
MIME-Version: 1.0
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: 7bit
Thread-Index: Ach+HooL9xFEZnEYSmuPNBF/MA6pigABk+xwAABSPNAAAI+vMAAA7S+Q
Content-Language: en-us
From: Will Johnson <willjohnsonsearch@gmail.com>

Don't forget the number 1 reason: speed.  For certain types of queries a
search engine can return results orders of magnitude faster than a database.
I've seen search engines return hits in hundreds of milliseconds when the
same database query took hours or even days.  That's not to say that a
search engine is always better, just the it often times is for when the
inputs and outputs are carefully defined.

- will

-----Original Message-----
From: Darren Hartford [mailto:dhartford@ghsinc.com] 
Sent: Tuesday, March 04, 2008 1:52 PM
To: java-user@lucene.apache.org
Subject: RE: Why indexing database is necessary? (RE: indexing database)

Indexing with lucene/nutch on top of/instead of DB indexing for:

1) relativity scoring
2) alias searching (i.e. a large amount of aliases, like first names)
3) highlighting
4) cross-datasource searching (multi DB, DB + XML files, etc).

As for best approach to externally index, I do not have any direct
pointers.  I would recommend looking at an ETL tool that can be extended
for this purpose (I've started writing a plugin for Pentaho, but got
pulled off and haven't finished it -- and that was for Solr, not
lucene/nutch).

-D

> -----Original Message-----
> From: Duan, Nick [mailto:NDuan@mcdonaldbradley.com]
> Sent: Tuesday, March 04, 2008 1:33 PM
> To: java-user@lucene.apache.org
> Subject: Why indexing database is necessary? (RE: indexing database)
> 
> Could anyone provide any insight on why someone would use nutch/lucene
> or any other search engines to index relational databases? With use
> cases if possible?  Shouldn't the database's own indexing mechanism be
> used since it is more efficient?
> 
> If there is such a need of indexing the database content using search
> engines, what would be the best approach other than de-normalizing the
> database?
> 
> Thanks a lot in advance!
> 
> ND
> -----Original Message-----
> From: payo [mailto:payo22@yahoo.com]
> Sent: Tuesday, March 04, 2008 12:36 PM
> To: nutch-user@lucene.apache.org
> Subject: indexing database
> 
> 
> hi to all
> 
> i can index a database with nutch?
> 
> i am use nutch 0.8.1
> 
> thanks
> --
> View this message in context:
> http://www.nabble.com/indexing-database-tp15832696p15832696.html
> Sent from the Nutch - User mailing list archive at Nabble.com.
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org