tomcat-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mathias Walter" <mathias.wal...@gmx.net>
Subject howto stop crawler and bots according to their user agent string
Date Tue, 15 Jul 2008 10:04:12 GMT
Hi,

I'm using Tomcat without the Apache Web Server. Now, some bots are crawling
my database driven website.

How can I prevent crawler and bots according to their user agent?

I've put a robots.txt in webapps/ROOT, but this file is not read again. I'd
like to stop crawlers by their useragent string.


--
Mit freundlichen Grüßen,
Mathias Walter


---------------------------------------------------------------------
To start a new topic, e-mail: users@tomcat.apache.org
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org


Mime
View raw message