httpd-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeremy Hilton <jeremy-l...@adtcs.com>
Subject Re: [users@httpd] mod_throttle relaxing restrictions for crawlers
Date Thu, 27 Jan 2005 22:02:37 GMT
On 1/27/05 4:45 PM, "Manuel Lemos" <mlemos@acm.org> wrote:

> Hello,
> 
> I want to use mod_throttle to limit the rate of requests that can be
> done from each client IP.
> 
> However, I also need to allow the internal crawler, which is HT:Dig, to
> crawl the site without retrictions.
> 
> My problem is that I could not find a way to specify a different
> throttle policy for clients accessing from a given IP nor even from a
> given user agent.
> 
> Anybody has any ideas on how to solve this problem?

http://www.snert.com/Software/mod_throttle/


---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Mime
View raw message