nutch-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yoav Shapira" <>
Subject Re: How to authenticate with cookies?
Date Wed, 07 May 2008 14:40:22 GMT
On Wed, May 7, 2008 at 10:24 AM,  <> wrote:
> Heh, I think this is another good use-case for HostDB, which doesn't yet exist.  If this
existed, we could store a cookie for each host in >HostDB, and include it in CrawlDatum
entries used in Fetcher(2).  You'd have to dig down to o.a.n.protocol.httpclient.Http and
add >cookies to the request there, I believe.

How do I enable protocol-httpclient and/or make sure it's the one being used?


View raw message