httpd-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rich Bowen <rbo...@rcbowen.com>
Subject RE: [users@httpd] robots.txt
Date Thu, 02 Jan 2003 11:33:47 GMT
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On Thu, 2 Jan 2003, Jeff Cohen wrote:

> That's the problem, I don't have such file robots.txt. I guess the
> content should be text isn't? :)
> But Chris says not to be worried, so I'm not.

See http://www.robotstxt.org/wc/robots.html for a complete description
of what you should put in this file. You should not be "worried" about
it, but you should learn about it, and create one to put on your site,
if you want your site to be indexed by search engines, and you want them
to do it in a friendly manner.

- -- 
Oh I have slipped the surly bonds of earth
And danced the sky on laughter-silvered wings
 --High Flight (John Gillespie Magee)
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.1 (GNU/Linux)
Comment: Made with pgp4pine 1.75-6

iD8DBQE+FCOsXP03+sx4yJMRArVTAKCAc4E5UZmoHh/0s6MtUwDBFAziswCfTRDU
DI16Lc3spdKJokOMd0YBkAE=
=LtEw
-----END PGP SIGNATURE-----



---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Mime
View raw message