httpd-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Boyle Owen" <Owen.Bo...@swx.com>
Subject RE: [users@httpd] Robots.txt and virtualhost
Date Tue, 08 Jun 2004 09:26:34 GMT
> -----Original Message-----
> From: Thomas Gabrielsen [mailto:apache@arton.no]
> 
> Can you (or anybody) tell me more about how robots work, or 
> where I can read
> more about it? Specially the google bot.

http://www.robotstxt.org/ 

Rgds,
Owen Boyle
Disclaimer: Any disclaimer attached to this message may be ignored. 

> 
> Thanks,
> Thomas
> 
> ----- Original Message ----- 
> From: "Zoe Ballz" <zoe@zoeballz.tv>
> To: <users@httpd.apache.org>
> Sent: Saturday, June 05, 2004 1:31 AM
> Subject: Re: [users@httpd] Robots.txt and virtualhost
> 
> 
> Hiya
> 
> You are right - thats exactly the reason !!!!!!!!!
> 
> Zoe
> 
> http://zoeballz.net - Website Hosting for the Transgendered Community
>   ----- Original Message ----- 
>   From: Thomas Gabrielsen
>   To: users@httpd.apache.org
>   Sent: Friday, June 04, 2004 7:44 PM
>   Subject: [users@httpd] Robots.txt and virtualhost
> 
> 
>   Hi
> 
>   I have a question about Robots.txt files and virtualhost's. 
> When I have
> one
>   main directory and one (named) virtualhost. Both are sharing one ip.
> Should
>   I add then something special in the robots.txt file that 
> are placed in the
>   main directory pointing the robots to the virtualhost directory? The
> reason
>   I ask is that I get MANY requests for robots.txt in the 
> main directory
>   compared to the virtualhost. Now, the mainhost has been up 
> for a long time
>   compared to the virtualhost (which has been up for a week) 
> so that could
> be
>   the reason. I just wanted to ask you fine people to be sure :)
> 
>   Thanks,
>   Thomas Gabrielsen
> 
> 
> 
> 
>   
> ---------------------------------------------------------------------
>   The official User-To-User support forum of the Apache HTTP 
> Server Project.
>   See <URL:http://httpd.apache.org/userslist.html> for more info.
>   To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>      "   from the digest: users-digest-unsubscribe@httpd.apache.org
>   For additional commands, e-mail: users-help@httpd.apache.org
> 
> 
> 
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP 
> Server Project.
> See <URL:http://httpd.apache.org/userslist.html> for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>    "   from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
> 
> 
Diese E-mail ist eine private und persönliche Kommunikation. Sie hat
keinen Bezug zur Börsen- bzw. Geschäftstätigkeit der SWX Gruppe. This
e-mail is of a private and personal nature. It is not related to the
exchange or business activities of the SWX Group. Le présent e-mail est
un message privé et personnel, sans rapport avec l'activité boursière du
Groupe SWX.

This message is for the named person's use only. It may contain
confidential, proprietary or legally privileged information. No
confidentiality or privilege is waived or lost by any mistransmission.
If you receive this message in error, please notify the sender urgently
and then immediately delete the message and any copies of it from your
system. Please also immediately destroy any hardcopies of the message.
You must not, directly or indirectly, use, disclose, distribute, print,
or copy any part of this message if you are not the intended recipient.
The sender's company reserves the right to monitor all e-mail
communications through their networks. Any views expressed in this
message are those of the individual sender, except where the message
states otherwise and the sender is authorised to state them to be the
views of the sender's company. 



---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Mime
View raw message