nutch-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Susam Pal <>
Subject Re: Crawling authenticated websites !
Date Thu, 18 Mar 2010 16:25:31 GMT
On Thu, Mar 18, 2010 at 7:27 PM, Ranganath Cuddapah
<> wrote:
> Hello,
> Is there a way to configure Nutch to crawl "forms authenticated" websites?
> What I mean is the kind of websites which look up a database for
> authentication/authorization and does not allow you to view secure pages
> unless authenticated. This need not be specifically on https, but on http
> too..!
> Any help is greatly appreciated.
> Thanks,
> Ranganath
> P.S : Not sure if this is the right email to ask the question. Apologies, in
> advance. is the right place ask this. I've
included it in CC.

This feature is not present in Nutch. We have recorded the summary of
some old discussions regarding this here: But this was never

Susam Pal

View raw message