tomcat-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rashmi Rubdi <dev_subscripti...@yahoo.com>
Subject Re: Web spiders - disabling jsessionid
Date Mon, 04 Dec 2006 02:30:57 GMT
One thing about search engine bots though is that repairs to jsessionid (removing jsession
id) from URLs won't be instantaneous, because they cache all URLs, and on subsequent visits
they visit each cached URL.

This means that even if you solve the problem of jsessionid now, you will still see some URLs
jsessionid in your logs for a few months before they vanish from the crawler's cache. This
is how it works for broken links as well, it takes a while for broken links to disappear from
the crawler's cache.

That's why testing your case with your own crawler is better than waiting for the next crawl
from other search engines.


 
____________________________________________________________________________________
Do you Yahoo!?
Everyone is raving about the all-new Yahoo! Mail beta.
http://new.mail.yahoo.com

---------------------------------------------------------------------
To start a new topic, e-mail: users@tomcat.apache.org
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org


Mime
View raw message