tomcat-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mathias Walter" <>
Subject howto stop crawler and bots according to their user agent string
Date Tue, 15 Jul 2008 10:04:12 GMT

I'm using Tomcat without the Apache Web Server. Now, some bots are crawling
my database driven website.

How can I prevent crawler and bots according to their user agent?

I've put a robots.txt in webapps/ROOT, but this file is not read again. I'd
like to stop crawlers by their useragent string.

Mit freundlichen Grüßen,
Mathias Walter

To start a new topic, e-mail:
To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message