httpd-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mark H. Wood" <mw...@IUPUI.Edu>
Subject Re: [users@httpd] OT: where to discuss general issues concerning spiders?
Date Wed, 13 Jun 2007 13:15:10 GMT
On Sat, Jun 09, 2007 at 12:46:23AM -0700, lists wrote:
> Mark H. Wood wrote:
> > Your chance to tell me where to go :-)
> > 
> > I'm looking for a good place to discuss non-server-specific issues
> > relating to spidering.  Such as:  "I have this great new proposal that
> > would help us to segregate spider and real-user access in our
> > statistics...."
> > 
> do you mean something like this?
> [AWstats robot report]

Well, I have a patched version of DSpace (a document archive web
application) that shows the download count for each individual
document on the document's detail page, and download totals for each
community and collection.  I want to make those as accurate as
possible, where "accurate" means "not including spider accesses".  So
yes, I want to do something like AWstats is doing to segregate access
statistics, but AWstats is not the answer.  And I'd like to discuss,
somewhere, ways to make it easier to identify *new* spiders *before*
they pollute my stat.s.

Mark H. Wood, Lead System Programmer   mwood@IUPUI.Edu
Typically when a software vendor says that a product is "intuitive" he
means the exact opposite.

View raw message