forrest-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Thorsten Scherler <thorsten.scherler....@juntadeandalucia.es>
Subject Re: web.archive.org stoped indexing our site
Date Thu, 10 May 2007 09:48:56 GMT
On Thu, 2007-05-10 at 19:33 +1000, David Crossley wrote:
> Thorsten Scherler wrote:
> > Hi all,
> > 
> > when I was trying to find the origin of the dead link reported by Bart I
> > found out that the waybackmaschine has stop indexing our web site.
> > http://web.archive.org/web/*/http://forrest.apache.org
> > 
> > The last entry is Apr 24, 2006, which makes me think whether we changed
> > the .htaccess or robot.txt to exclude crawlers. Is this by purpose?
> 
> I am not aware anything changed at our end.
> 
> Try our dev archives, Ferdinand and i talked
> about this before.
> 
> You get a similar result for www.apache.org
> 
> I wonder if the results are deliberately old,
> i.e. they don't show the last six months results
> so that people don't use it as a daily tool.

Ah, ok that makes sense and explains the gap. Maybe they just extended
the period to a full year.

salu2
-- 
Thorsten Scherler                                 thorsten.at.apache.org
Open Source Java                      consulting, training and solutions


Mime
View raw message