httpd-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeremy Hilton <>
Subject Re: [users@httpd] mod_throttle relaxing restrictions for crawlers
Date Thu, 27 Jan 2005 22:02:37 GMT
On 1/27/05 4:45 PM, "Manuel Lemos" <> wrote:

> Hello,
> I want to use mod_throttle to limit the rate of requests that can be
> done from each client IP.
> However, I also need to allow the internal crawler, which is HT:Dig, to
> crawl the site without retrictions.
> My problem is that I could not find a way to specify a different
> throttle policy for clients accessing from a given IP nor even from a
> given user agent.
> Anybody has any ideas on how to solve this problem?

The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:> for more info.
To unsubscribe, e-mail:
   "   from the digest:
For additional commands, e-mail:

View raw message