Return-Path: Mailing-List: contact modperl-help@apache.org; run by ezmlm Delivered-To: mailing list modperl@apache.org Received: (qmail 81495 invoked from network); 25 Mar 2000 00:04:47 -0000 Received: from nazgul.ne.mediaone.net (HELO hinckley.com) (24.218.230.12) by locus.apache.org with SMTP; 25 Mar 2000 00:04:47 -0000 Received: from [192.168.1.93] (192.168.1.93) by hinckley.com with ESMTP (Eudora Internet Mail Server 2.2.2); Fri, 24 Mar 2000 19:04:46 -0500 Mime-Version: 1.0 X-Sender: nazgul%hinckley.com@gate.somewhere.com (Unverified) Message-Id: In-Reply-To: <20000324015955.23822.qmail@web114.yahoomail.com> References: <20000324015955.23822.qmail@web114.yahoomail.com> Date: Fri, 24 Mar 2000 19:03:08 -0500 To: Remi Fasol From: Kee Hinckley Subject: Re: Apache::ASP, cookieless sessions, and search engine Cc: Joshua Chamas , modperl@apache.org -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 X-Spam-Rating: locus.apache.org 1.6.2 0/1000/N At 5:59 PM -0800 3/23/00, Remi Fasol wrote: >ps. do i run the risk of having other cookieless >bots/indexers churning endlessly on my site if i don't >know which user_agents to filter out? How about using robots.txt to direct them away from the session URLs, but leave open a link that just gives a raw listing of the entire site. I do something similar at http://commons.somewhere.com/, robots won't follow my indices since they have ? args, so I give them a small hidden link (an _) at the bottom of each section page, that leads them to database generated lists of all the files on the site. - -- Kee Hinckley - Somewhere Consulting Group - Cyberspace Architects(rm) I'm not sure which upsets me more: that people are so unwilling to accept responsibility for their own actions, or that they are so eager to regulate everyone else's. -----BEGIN PGP SIGNATURE----- Version: PGPfreeware 6.5.2 for non-commercial use iQA/AwUBONwCmyZsPfdw+r2CEQIvZQCfQPeSUi0GJT+nehNmZnmn1ttD2x0AoLCu tKIbL7WS1Xpi4Dk8NtiL7054 =krRT -----END PGP SIGNATURE-----