httpd-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ruth, Brice D" <BR...@amfam.com>
Subject [users@httpd] authenticating robots by user-agent & double reverse lookup
Date Fri, 22 Sep 2006 14:03:48 GMT
Good morning.
 
After reading the latest Google Webmaster blog entry
(http://googlewebmastercentral.blogspot.com/2006/09/how-to-verify-google
bot.html) I got to thinking about how one might be able to configure
Apache deny visits from bots that purport to be Googlebot (or anything
else) but do not pass the double reverse lookup for googlebot.com.
 
Reading the docs, it looks like mod_access will do a double reverse
lookup on something like:
 
Allow from googlebot.com
 
And mod_access can also respect env variables set via
 
SetEnvIf User-Agent Googlebot
 
But, how would a webmaster go about combining these to stop scammers?
 
Thanks for any tips!
 
-Brice

Mime
View raw message