Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (nike.apache.org: domain of anshumg@gmail.com designates
 209.85.216.186 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:from:date:message-id:subject:to
         :content-type;
        b=RK1X/Vm22DuHEoK33ei/o+gt+EiRKhRUWaUoddQn/Lch+9VdnpH1t4wlG9g3qJZDSb
         Q23MBitULZ8WVQn8ByAsIfQQJvq7kTtg74OqMg9QY5gKf9AKRZlepPGpucsDX6yhhXZR
         9QqLuANTjd9Kxvb+0I9mhBhgkTSL+kqDhhJBg=
MIME-Version: 1.0
In-Reply-To: <805803.47041.qm@web53208.mail.re2.yahoo.com>
References: <805803.47041.qm@web53208.mail.re2.yahoo.com>
From: Anshum <anshumg@gmail.com>
Date: Wed, 3 Feb 2010 07:27:16 +0530
Message-ID: <867513fe1002021757t53533a49he725a0dda1a77b8@mail.gmail.com>
Subject: Re: Limiting search result for web search engine
To: java-user@lucene.apache.org
Content-Type: multipart/alternative; boundary=0016e64ddac8dd80a4047ea88a81

--0016e64ddac8dd80a4047ea88a81
Content-Type: text/plain; charset=ISO-8859-1

Hi Mike,
Not really through queries, but you may do this by writing a custom
collector. You'd need some supporting data structure to mark/hash the
occurrence of a domain in your result set.

--
Anshum Gupta
Naukri Labs!
http://ai-cafe.blogspot.com

The facts expressed here belong to everybody, the opinions to me. The
distinction is yours to draw............


On Wed, Feb 3, 2010 at 6:56 AM, Mike Polzin <mikepolzin@yahoo.com> wrote:

> I am working on building a web search engine and I would like to build a
> reults page similar to what Google does. The functionality I am looking to
> include is what I refer to a "rolling up" sites, meaning that even if a
> particular site (defined by its base URL) has many relevent hits on various
> pages for the searches keywords, that site is only shown once in the results
> listing with a link to the most relevent hit on that site. What I do not
> want is to have one site dominate a search results page.
>
> Does it make sense to just do the search, get the hits list and then
> programatically remove the results which, although they meet the search
> criteria, are not as relevent? Is there a way to do this through queries?
>
> Thanks in advance!
>
> Mike
>
>
>

--0016e64ddac8dd80a4047ea88a81--