www-mirrors mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Brian Behlendorf <br...@hyperreal.com>
Subject Re: some updates [Goran Oberg <goggi@dc.luth.se>] (fwd)
Date Fri, 13 Jun 1997 08:40:34 GMT

---------- Forwarded message ---------- 
To: Brian Behlendorf <brian@hyperreal.com>
cc: mirrors@apache.org
Subject: Re: some updates 
Date: Fri, 13 Jun 1997 09:36:23 +0200
From: Goran Oberg <goggi@dc.luth.se>

> The release of 1.2.0 caused an unprecedented amount of traffic on our
> site; so much so that the bandwidth provider for www.apache.org has
> begun to grumble.  To address this, we have taken some measures to bolster
> the effectiveness of the site in supporting mirrors:

How are the load spread between http and ftp? I have choosen not run a
ftp-service at apache.dc.luth.se because of the extra work maintaining a secure
anonymous ftp-server. It would be interesting to know more about how many
accesses different mirrors get and how they are distributed between http and
ftp.


> 1) We will now be running CGI scripts on mirror sites.  Previously all CGI
> scripts, such as the search field and bug database, had an explicit link
> back to www.apache.org.  These CGI scripts only rely upon perl 4 (or 5)
> being at "/usr/local/bin/perl".  Is this a problem?

"We will now be running CGI scripts on mirror sites." Hmm, I don't think it's
that easy. Apache is a great software in many ways, one of these ways is that
with a little basic knowledge of the Apache system it's quite easy to maintain
basic security. I would expect that most, if not all, mirrored www-sites won't
let any executable file with cgi-suffix be executed by default. At least it 
wouldn't here at apache.dc.luth.se.

I have made loose sketches on a simple distributed version of CPAN that
wouldn't require every CPAN-like resolution go through one single point of
failure and/or congestion. If there's enough interest in this idea I could
perhaps pick this up again.

Also, as Apache development spreads, perhaps an overall framework similar to
Perl's CPAN module organization would be useful. See <URL:http://www.perl.com/
CPAN/CPAN.html> for more info.


> There may be more issues brought up by this than I anticipated - let's
> discuss them here.  Thanks again to everyone for providing mirror sites,
> hopefully the storm will die down soon.

I'll append some statistics, hits by day and where visitors are entering from.
Perhaps apache.dc.luth.se is somewhat off the map, located at the north-most
university of Sweden, but when you look at the network topology in SUNET and
NORDUnet apache.dc.luth.se is able to serve most of the sites connected to
NORDUnet at a rate limited mainly be the bandwidth closest to the user, e.g.
local lans.

Here's some simple statistics I've thrown together. It's the number of accesses
the last couple of week and a count of from where people are arriving.

Out of 8892 accesses, 6822 (77%) where acknowledging their origin. Out of these
there were 3222 (47%) originating from a non-apache.dc.luth.se address. I'll
list those last in my letter. Anything after a '?' in the addresses have been
removed to protect the anonymity of search-engines users. Any 'file'-URLs have
also been removed.

I hope these statistics is of interest to someone or can be useful in the
analysis of how the efforts spreading the load should proceed.


1997-04-26 :      85  (   0.1 kreq/day,   0.00 Mreq/month)
1997-04-27 :     100  (   0.1 kreq/day,   0.00 Mreq/month)
1997-04-28 :     231  (   0.2 kreq/day,   0.01 Mreq/month)
1997-04-29 :     488  (   0.5 kreq/day,   0.01 Mreq/month)
1997-04-30 :     380  (   0.4 kreq/day,   0.01 Mreq/month)
1997-05-01 :     169  (   0.2 kreq/day,   0.01 Mreq/month)
1997-05-02 :     179  (   0.2 kreq/day,   0.01 Mreq/month)
1997-05-03 :     209  (   0.2 kreq/day,   0.01 Mreq/month)
1997-05-04 :     165  (   0.2 kreq/day,   0.00 Mreq/month)
1997-05-05 :     270  (   0.3 kreq/day,   0.01 Mreq/month)
1997-05-06 :     212  (   0.2 kreq/day,   0.01 Mreq/month)
1997-05-07 :     276  (   0.3 kreq/day,   0.01 Mreq/month)
1997-05-08 :     124  (   0.1 kreq/day,   0.00 Mreq/month)
1997-05-09 :     175  (   0.2 kreq/day,   0.01 Mreq/month)
1997-05-10 :     133  (   0.1 kreq/day,   0.00 Mreq/month)
1997-05-11 :     106  (   0.1 kreq/day,   0.00 Mreq/month)
1997-05-12 :     277  (   0.3 kreq/day,   0.01 Mreq/month)
1997-05-13 :     266  (   0.3 kreq/day,   0.01 Mreq/month)
1997-05-14 :     298  (   0.3 kreq/day,   0.01 Mreq/month)
1997-05-15 :     224  (   0.2 kreq/day,   0.01 Mreq/month)
1997-05-16 :     315  (   0.3 kreq/day,   0.01 Mreq/month)
1997-05-17 :      54  (   0.1 kreq/day,   0.00 Mreq/month)
1997-05-18 :     161  (   0.2 kreq/day,   0.00 Mreq/month)
1997-05-19 :     150  (   0.1 kreq/day,   0.00 Mreq/month)
1997-05-20 :     215  (   0.2 kreq/day,   0.01 Mreq/month)
1997-05-21 :     210  (   0.2 kreq/day,   0.01 Mreq/month)
1997-05-22 :     159  (   0.2 kreq/day,   0.00 Mreq/month)
1997-05-23 :     201  (   0.2 kreq/day,   0.01 Mreq/month)
1997-05-24 :      81  (   0.1 kreq/day,   0.00 Mreq/month)
1997-05-25 :      70  (   0.1 kreq/day,   0.00 Mreq/month)
1997-05-26 :     256  (   0.3 kreq/day,   0.01 Mreq/month)
1997-05-27 :     194  (   0.2 kreq/day,   0.01 Mreq/month)
1997-05-28 :     136  (   0.1 kreq/day,   0.00 Mreq/month)
1997-05-29 :     109  (   0.1 kreq/day,   0.00 Mreq/month)
1997-05-30 :     120  (   0.1 kreq/day,   0.00 Mreq/month)
1997-05-31 :     140  (   0.1 kreq/day,   0.00 Mreq/month)
1997-06-01 :      57  (   0.1 kreq/day,   0.00 Mreq/month)
1997-06-02 :      68  (   0.1 kreq/day,   0.00 Mreq/month)
1997-06-03 :      95  (   0.1 kreq/day,   0.00 Mreq/month)
1997-06-04 :     179  (   0.2 kreq/day,   0.01 Mreq/month)
1997-06-05 :     139  (   0.1 kreq/day,   0.00 Mreq/month)
1997-06-06 :     329  (   0.3 kreq/day,   0.01 Mreq/month)
1997-06-07 :     188  (   0.2 kreq/day,   0.01 Mreq/month)
1997-06-08 :      33  (   0.0 kreq/day,   0.00 Mreq/month)
1997-06-09 :     186  (   0.2 kreq/day,   0.01 Mreq/month)
1997-06-10 :     240  (   0.2 kreq/day,   0.01 Mreq/month)
1997-06-11 :     165  (   0.2 kreq/day,   0.00 Mreq/month)
1997-06-12 :     216  (   0.2 kreq/day,   0.01 Mreq/month)


 488 http://www.apache.org/
 192 http://index.opentext.net/OTI_Robot.html
  93 http://euroseek.com
  72 http://www.unit.liu.se/apache/
  69 http://www.apache.org/mirrors.html
  37 http://www.dsv.su.se/webserver/index.html
  30 http://www.dsv.su.se/webserver/www-server-dsv.html
  24 http://www.excite.com/search.gw
  20 http://www.pal.xgw.fi/apache/
  14 http://www.infoseek.com/Titles
  12 http://webex.travsoft.com/
  10 http://www.infoap.com.ar/apache/
   6 http://www.apache.org/mirrors/list.cgi
   5 http://numeri.campus.luth.se/
   5 http://gd.tuwien.ac.at/infosys/servers/http/apache/
   4 http://www.apache.org/mirrors/
   4 http://apache.www.nacamar.de/
   3 http://www.taxnews.com/
   3 http://sunsite.doc.ic.ac.uk/packages/apache/
   3 http://bond.edu.au/External/Misc/apache/
   2 http://www/webserver/www-server-dsv.html
   2 http://www.ut.ee/apache/
   2 http://www.ub.lu.se/~marten/links/refs.html
   2 http://www.metacrawler.com/crawler
   2 http://www.euroseek.net/query
   2 http://www.apache.org/#download
   2 http://sunsite.icm.edu.pl/pub/www/apache/
   2 http://ftp.cs.tu-berlin.de//pub/net/www/apache/
   2 http://excite.com/search.gw
   2 http://apache.org/
   1 http://www2.happysize.co.jp/apache/
   1 http://www.uuserv.net.tw/apache/
   1 http://www.ut.ee/apache/mirrors.html
   1 http://www.syd.dit.csiro.au/tools/apache/
   1 http://www.student.kiruna.se/
   1 http://www.spies.com/~ceej/Journal/Mar97/970304.html
   1 http://www.powertech.no/apache/
   1 http://www.oncomdis.on.ca/apache/
   1 http://www.module.vympel.msk.ru/mirror/apache/
   1 http://www.module.vympel.msk.ru/eng/mirror/apache/
   1 http://www.mbh.org/archive/apache/
   1 http://www.iworld.net/apache/
   1 http://www.it.kth.se/edu/gru/Fingerinfo/telesys.finger/Mobile.VT97/Labs/bookmark.html
   1 http://www.ies.luth.se/depts/system/unix.htm
   1 http://www.iWorld.net/apache/
   1 http://www.apache.de/
   1 http://sunsite.cnlab-switch.ch/www/mirror/apache/
   1 http://sunsite.auc.dk/apache/
   1 http://subzero.campus.luth.se/index
   1 http://phf.apache.org/
   1 http://mathema.it/pub/apache/
   1 http://info.dsv.su.se/webserver/index.html
   1 http://http://sunsite.sut.ac.jp/pub/archives/WWW/apache/mirrors.html
   1 http://http://sunsite.sut.ac.jp/pub/archives/WWW/apache/default.html
   1 http://guide-p.infoseek.com/Titles
   1 http://foobar.szabinet.hu/apache/
   1 http://dsv.su.se/webserver/index.html
   1 http://boomer.digibel.be/mirrors/apache/
   1 http://apache.oncomdis.on.ca/
   1 http://apache.compuex.com/
   1 http://apache.arctic.org/
   1 http://SunSITE.sut.ac.jp/pub/archives/WWW/apache/
   1 ftp://ftp.rediris.es/mirror/apache/index.html
   1 ftp://ftp.apache.org/apache/mirrors.html




Mime
View raw message