Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of chris.lu@gmail.com designates
 64.233.182.188 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=beta;
        h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:references;
        b=XXELYcY6VtB9KH5imBn0Vu0+d/KwduUNQW/EGjRmokTG4AoCg/jClU6j/QNjrmVg1o1dj/nCvuB+EDl8/TkKhjbNak6qDTZWsBqGsX4lPt4e9MJFAbetDG2+bSQ0VctPdpFOI3kfDSlQOuT+/Kp9Ab8TuiIxMJIFxEMeUYph/vg=
Message-ID: <6e3ae6310710231122k3daa5c25gd38cd7fb6c7cf4a4@mail.gmail.com>
Date: Tue, 23 Oct 2007 11:22:49 -0700
From: "Chris Lu" <chris.lu@gmail.com>
To: java-user@lucene.apache.org
Subject: Re: Meta- search descriptions
In-Reply-To: <57669.58876.qm@web59204.mail.re1.yahoo.com>
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_Part_2661_14676035.1193163769774"
References: <6e3ae6310710230925q23199796md9c4bf1423dcd71b@mail.gmail.com>
	 <57669.58876.qm@web59204.mail.re1.yahoo.com>

------=_Part_2661_14676035.1193163769774
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

Since you only try to index your client's pages, I think it should be doable
to use regular expressions or similar to find out the meta info. Or you can
ask your clients to expose some XML or RSS that you can process more easily.

But still, accessing database directly will save you tons of time to parse
out the data.

-- 
Chris Lu
-------------------------
Instant Scalable Full-Text Search On Any Database/Application
site: http://www.dbsight.net
demo: http://search.dbsight.com
Lucene Database Search in 3 minutes:
http://wiki.dbsight.com/index.php?title=Create_Lucene_Database_Search_in_3_minutes

On 10/23/07, Cool Coder <techcool.kumar@yahoo.com> wrote:
>
> >Why not index their database directly?
> I should have provided about this in my first mail. Anyway, clients are
> ready to allow for indexing their DB, but they have some confidential data
> as well as information about their clients and all data are so much tightly
> coupled, it is difficult for them to allow any third-party tool to index
> their DB. And of course, this is the last option, in case I could not able
> to develop a robust indexing meachanism.
>   Now, with all these difficulties, is it possible to develop a robust
> indexer? I would appreciate your input/suggestion. It does not matter how
> relevant but I would appreciate if you can give me your opinion on this.
>
>   - BR
>   Chris Lu <chris.lu@gmail.com> wrote:
>     Why not index their database directly?
>
>
> --
> Chris Lu
> -------------------------
> Instant Scalable Full-Text Search On Any Database/Application
> site: http://www.dbsight.net
> demo: http://search.dbsight.com
> Lucene Database Search in 3 minutes:
>
> http://wiki.dbsight.com/index.php?title=Create_Lucene_Database_Search_in_3_minutes
>
>
> On 10/23/07, Cool Coder wrote:
> >
> > I was just looking into couple of search engines like indeed.com or
> > bixee.com and I really got surprised the accuracy of information they
> have
> > built in their indexes and also they provide for search result.
> > I have same sort of requirement to build indexes for all my cleints site
> > and provide search capability. WHile indexing a page, parser should know
> the
> > format/structure of the page, then only it would be possible to index a
> page
> > accurately. If site changes their content structure quickly then
> > crawler/indexer also has to change the meta-info i.e. format about the
> > page.
> >
> > I am basically developing a way of indexing my client pages to provide
> > search capability with accurate information (like there are number of
> > products in a clients page and I need to get all product data and index
> > accordingly). Hence I need some sort of Indexing which will depend upon
> meta
> > search information (Basically describe the content of pages) like the
> way I
> > have described above and indexer will work based on meta search
> information.
> >
> > Can anybody suggest me whether this is possible or not.
> >
> > regards,
> > BR
> >
> > __________________________________________________
> > Do You Yahoo!?
> > Tired of spam? Yahoo! Mail has the best spam protection around
> > http://mail.yahoo.com
>
>
>
> __________________________________________________
> Do You Yahoo!?
> Tired of spam?  Yahoo! Mail has the best spam protection around
> http://mail.yahoo.com

------=_Part_2661_14676035.1193163769774--