httpd-cvs mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From erikab...@apache.org
Subject cvs commit: httpd-docs-1.3/htdocs/manual/misc howto.html
Date Mon, 30 Dec 2002 18:02:04 GMT
erikabele    2002/12/30 10:02:04

  Modified:    htdocs/manual/misc howto.html
  Log:
  Fixed links to Martijn Kosters webrobots pages.
  
  Revision  Changes    Path
  1.15      +2 -2      httpd-docs-1.3/htdocs/manual/misc/howto.html
  
  Index: howto.html
  ===================================================================
  RCS file: /home/cvs/httpd-docs-1.3/htdocs/manual/misc/howto.html,v
  retrieving revision 1.14
  retrieving revision 1.15
  diff -u -r1.14 -r1.15
  --- howto.html	8 Oct 2001 01:26:54 -0000	1.14
  +++ howto.html	30 Dec 2002 18:02:04 -0000	1.15
  @@ -167,7 +167,7 @@
       reputation for sending hundreds/thousands of requests to each
       site, often resulting in the site being overloaded. Things have
       improved dramatically since then, thanks to <a
  -    href="http://info.webcrawler.com/mak/projects/robots/guidelines.html">
  +    href="http://www.robotstxt.org/wc/guidelines.html">
       Guidelines for Robot Writers</a>, but even so, some robots may
       exhibit unfriendly behavior which the webmaster isn't willing
       to tolerate, and will want to stop.</p>
  @@ -182,7 +182,7 @@
       <p>If you decide to exclude robots completely, or just limit
       the areas in which they can roam, create a
       <code>robots.txt</code> file; refer to the <a
  -    href="http://info.webcrawler.com/mak/projects/robots/robots.html">
  +    href="http://www.robotstxt.org/wc/robots.html">
       robot information pages</a> provided by Martijn Koster for the
       syntax.</p>
       <hr />
  
  
  

Mime
View raw message