httpd-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dharmendra.T" <>
Subject Re: [users@httpd] robots.txt
Date Thu, 02 Jan 2003 09:09:20 GMT
On Thu, 2003-01-02 at 14:07, Jeff Cohen wrote:
> Hi All,
> Does anyone of you get the robots.txt file requests from the internet??
> It seems that I'm starting to get it almost every 3-4 hours a day, every
> time from a different IP.
> Is there a Virus going outta there that I'm not aware of?
> How can I block these requests for this file on the root directory?
> Help would be very appreciated,
> Jeff Cohen

What is the format of the file? Try 
#file robots.txt

What does the file contains?
Linux Enth

The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:> for more info.
To unsubscribe, e-mail:
   "   from the digest:
For additional commands, e-mail:

View raw message