httpd-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Charles Michener <>
Subject [users@httpd] How to rid a pest?
Date Sat, 15 Dec 2007 20:57:17 GMT
I have a couple of spider bots hitting my server that I do not wish to have access to my pages
- they ignore robots.txt, so I finally put them on my 'deny from xxxxx' list. This does deny
them access but they persist to keep trying - trying each page address at least 30 times -
several hits per second .  Is there a standard method to forward them to some black hole or
the FBI or ...?


Be a better friend, newshound, and know-it-all with Yahoo! Mobile.  Try it now.
View raw message