httpd-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From André Warnier ...@ice-sa.com>
Subject Re: [users@httpd] 404's to robots.txt?
Date Wed, 22 Jul 2009 00:07:24 GMT
Evan Platt wrote:
...
> 
> 65.55.106.173 - - [21/Jul/2009:09:44:43 -0700] "GET /robots.txt 
> HTTP/1.1" 404 208 "-" "msnbot/2.0b (+http://search.msn.com/msnbot.htm)"
> 65.55.106.112 - - [21/Jul/2009:10:11:43 -0700] "GET /robots.txt 
> HTTP/1.1" 404 208 "-" "msnbot/2.0b (+http://search.msn.com/msnbot.htm)"
> 65.55.106.166 - - [21/Jul/2009:11:03:35 -0700] "GET /robots.txt 
> HTTP/1.1" 404 208 "-" "msnbot/2.0b (+http://search.msn.com/msnbot.htm)"
> 65.55.106.160 - - [21/Jul/2009:11:09:07 -0700] "GET /robots.txt 
> HTTP/1.1" 200 28 "-" "msnbot/2.0b (+http://search.msn.com/msnbot.htm)"

I missed the above one on the first reading.  This is a 200, in the 
middle of the 404's.. ?

> 65.55.106.180 - - [21/Jul/2009:11:35:34 -0700] "GET /robots.txt 
> HTTP/1.1" 404 208 "-" "msnbot/2.0b (+http://search.msn.com/msnbot.htm)"
> 


---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Mime
View raw message