httpd-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Graham Leggett <minf...@sharp.fm>
Subject Re: URL scanning by bots
Date Tue, 30 Apr 2013 10:29:59 GMT
On 30 Apr 2013, at 12:03 PM, André Warnier <aw@ice-sa.com> wrote:

> The only cost would a relatively small change to the Apache webservers, which is what
my
> suggestion consists of : adding a variable delay (say between 100 ms and 2000 ms) to
any
> 404 response.

This would have no real effect.

Bots are patient, slowing them down isn't going to inconvenience a bot in any way. The simple
workaround if the bot does take too long is to simply send the requests in parallel. At the
same time, slowing down 404s would break real websites, as 404 isn't necessarily an error,
but rather simply a notice that says the resource isn't found.

Regards,
Graham
--


Mime
View raw message