tomcat-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tim Funk <funk...@joedog.org>
Subject Re: Web spiders - disabling jsessionid
Date Fri, 01 Dec 2006 13:17:46 GMT
Wrong. Google is very clear about not hiding user agent - as well as a 
the other major bots.

Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html

Just just for Googlebot in the user-agent header.

-Tim

Leon Rosenberg wrote:
> On 12/1/06, Tim Funk <funkman@joedog.org> wrote:
>> The easiest is the filter and custom HttpServletResponse which overrides
>> encodeURL() to do nothing.
>>
>> It could be made one step smarter by checking if the User agent is a
>> search engine bot to selectively execute or not.
>>
> 
> How do you want to achieve that?
> They disguise themself as normal browsers....
> Leon


---------------------------------------------------------------------
To start a new topic, e-mail: users@tomcat.apache.org
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org


Mime
View raw message