httpd-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ruth, Brice D" <>
Subject [users@httpd] authenticating robots by user-agent & double reverse lookup
Date Fri, 22 Sep 2006 14:03:48 GMT
Good morning.
After reading the latest Google Webmaster blog entry
bot.html) I got to thinking about how one might be able to configure
Apache deny visits from bots that purport to be Googlebot (or anything
else) but do not pass the double reverse lookup for
Reading the docs, it looks like mod_access will do a double reverse
lookup on something like:
Allow from
And mod_access can also respect env variables set via
SetEnvIf User-Agent Googlebot
But, how would a webmaster go about combining these to stop scammers?
Thanks for any tips!

View raw message