incubator-jspwiki-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harry Metske <>
Subject Re: Bocking Google Bot access
Date Sat, 05 Dec 2009 10:04:51 GMT
did you place robots.txt in the root of the web site hierarchy ?
Meaning the url for the robots.txt must be something like, and not ttp://
Did you look at you access.log to see if robots.txt is asked for ?


2009/12/5 Robert FORBES <>

> I don't want Google to index my pages, but I cannot find any means to block
> it.  As a last ditch effort, I have put the JSPWiki installation behind a
> firewall, but this is defeating the purpose for which it is intended.
> I am using Tomcat right now as the app server, and I have a robots.txt file
> in the WebApps folder, the folder below that (where Wiki.jsp is), the
> WEB_INF folder, and anywhere else I can think of.  The robots file looks
> like this:
> User-agent: *
> Disallow: /
> But it is not working.  Am I missing something obvious ? (likely)
> Robert

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message