httpd-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From lists <li...@jaqui-greenlees.net>
Subject Re: [users@httpd] OT: where to discuss general issues concerning spiders?
Date Sat, 09 Jun 2007 07:46:23 GMT
Mark H. Wood wrote:
> Your chance to tell me where to go :-)
> 
> I'm looking for a good place to discuss non-server-specific issues
> relating to spidering.  Such as:  "I have this great new proposal that
> would help us to segregate spider and real-user access in our
> statistics...."
> 

do you mean something like this?
Robots/Spiders visitors (Top 25)	
13 different robots*	Hits	Bandwidth	Last visit
Yahoo Slurp	        136+94	3.50 MB	        08 Jun 2007 - 13:49
MSNBot	                27+26	8.12 MB	        08 Jun 2007 - 11:17
Googlebot	        18+12	70.28 KB	08 Jun 2007 - 08:41
Unknown robot crawl     19+9	79.12 KB	08 Jun 2007 - 10:49
Unknown robot spider	6+3	44.45 KB	06 Jun 2007 - 02:02
Unknown robot robots    0+8	4.10 KB 	08 Jun 2007 - 12:20
Voila	                3+4	15.44 KB	06 Jun 2007 - 09:17
Ask	                3+3	20.39 KB	08 Jun 2007 - 10:07
Unknown robot bot/	2+2	7.37 KB	        06 Jun 2007 - 10:43
Netcraft	        2	0	        03 Jun 2007 - 06:21
MSNBot-media	        1+1	3.45 KB	        06 Jun 2007 - 08:12
Unknown robot           0+1	525 Bytes	05 Jun 2007 - 21:06
echo	                1	2.23 KB 	05 Jun 2007 - 05:37
* Robots shown here gave hits or traffic "not viewed" by visitors, so
they are not included in other charts. Numbers after + are successful
hits on "robots.txt" files

This is AWStats breakdown.

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Mime
View raw message