From dev-return-11283-apmail-forrest-dev-archive=forrest.apache.org@forrest.apache.org Tue Jul 20 16:09:38 2004 Return-Path: Delivered-To: apmail-forrest-dev-archive@www.apache.org Received: (qmail 8537 invoked from network); 20 Jul 2004 16:09:37 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur-2.apache.org with SMTP; 20 Jul 2004 16:09:37 -0000 Received: (qmail 52916 invoked by uid 500); 20 Jul 2004 16:09:19 -0000 Delivered-To: apmail-forrest-dev-archive@forrest.apache.org Received: (qmail 52826 invoked by uid 500); 20 Jul 2004 16:09:18 -0000 Mailing-List: contact dev-help@forrest.apache.org; run by ezmlm Precedence: bulk list-help: list-unsubscribe: list-post: Reply-To: dev@forrest.apache.org Delivered-To: mailing list dev@forrest.apache.org Received: (qmail 52702 invoked by uid 99); 20 Jul 2004 16:09:17 -0000 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests= X-Spam-Check-By: apache.org Received: from [65.42.175.122] (HELO ferrari.solidusdesign.com) (65.42.175.122) by apache.org (qpsmtpd/0.27.1) with SMTP; Tue, 20 Jul 2004 09:09:14 -0700 Received: (qmail 12158 invoked by uid 2009); 20 Jul 2004 16:09:09 -0000 Received: from localhost (sendmail-bs@127.0.0.1) by localhost with SMTP; 20 Jul 2004 16:09:09 -0000 Date: Tue, 20 Jul 2004 12:09:09 -0400 (EDT) From: Dave Brondsema X-X-Sender: user0009@ferrari To: Forrest Developers List Subject: Re: svn commit: rev 23083 - in forrest/trunk/src/forrestbot/webapp/src/webapp: . common In-Reply-To: <40FD3E6C.3000006@che-che.com> Message-ID: References: <20040720124055.60785.qmail@minotaur.apache.org> <40FD3E6C.3000006@che-che.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=ISO-8859-1 Content-Transfer-Encoding: QUOTED-PRINTABLE X-Virus-Checked: Checked X-Spam-Rating: minotaur-2.apache.org 1.6.2 0/1000/N On Tue, 20 Jul 2004, Juan Jose Pablos wrote: > brondsem@apache.org escribi=F3: > > Author: brondsem > > Date: Tue Jul 20 05:40:54 2004 > > New Revision: 23083 > > > > Modified: > > forrest/trunk/src/forrestbot/webapp/src/webapp/common/layout.jsp > > forrest/trunk/src/forrestbot/webapp/src/webapp/common/simple.jsp > > forrest/trunk/src/forrestbot/webapp/src/webapp/common/viewlog_frame.= jsp > > forrest/trunk/src/forrestbot/webapp/src/webapp/viewlog_header.jsp > > Log: > > robot meta tags to discourage indexing the generated websites > > what about a robots.txt file? > I thought about that, but that only works at domain.com/robots.txt and not at a directory like: domaind.com/forrestbot/robots.txt. Meta tags are not as widely supported as robots.txt but googlebot, msnbot and inktomi slurp support it so I think that's good enough. --=20 Dave Brondsema : dave@brondsema.net http://www.brondsema.net : personal http://www.splike.com : programming http://csx.calvin.edu : student org