Mailing-List: contact users-help@httpd.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@httpd.apache.org
Date: Mon, 25 Nov 2002 15:35:38 -0800
From: "J. Greenlees" <jaqui@shaw.ca>
To: users@httpd.apache.org
Message-id: <3DE2B3CA.20502@shaw.ca>
MIME-version: 1.0
Content-type: text/plain; charset=us-ascii; format=flowed
Content-transfer-encoding: 7BIT
User-Agent: Mozilla/5.0 (Windows; U; Win98; en-US; rv:1.0.1) Gecko/20020823
 Netscape/7.0
References: <8636C212C055EA4E85CC85D2AD62C9974254DC@LM-EXMSG-10.lm.lmig.com>
 <006a01c29492$be1b4730$2101a8c0@mit001>
Subject: Re: [users@httpd] Apache Bandwidth Utilization / Reporting

Steve,
from a friend that did this exact thing,
full steps for duplicating ( we have no idea when the hard drives ect 
will be returned, a warezer put pirated movie on his server, cost him 
the servers he was using for data transfer study )

"It's not too tough... if I ever get my #@$! hard drives and tape/CD 
backups returned to me from UEN, I could just post you a copy of the 
scripts.

Until then, you have to do a couple of things...

For data transfer:

Rig up awk to parse your httpd logs for anything ending in .zip, .exe, 
.sit, and .ogg, and whatever else you have set out for download. Then 
pipe that into something (awk or grep, machts nichts) that will suss out 
the filesize (you can either try and snag it out of the httpd call line, 
or out of an ls-generated table that will match the filename to the 
filesize) . Then, pipe those numbers into a flat temporary text file, 
and at the end of the day, let cron total the things all together, then 
do some housekeeping by running /dev/null against the temp number file, 
and backing up the daily httpd log (I used `date -I` to latch a 
timestamp onto the filename), then running /dev/zero against the main 
log file. You can then take that daily log file and run another script 
against it, like I did, to count how many download requests you did have 
(grep|count), count unique hits altogether (grep|diff|count), then echo 
the error lines for your clients to look at when they get lost on something.

HTH a little... "

hope that helps.
btw, the person quoted teaches networking / server admin at university.
I asked him your question, this was his reply. his preffered os is red 
hat linux.

Jaqui


Steve Leach wrote:
> Perhaps that is what is needed for bandwidth checks - my own requirement is
> just for the reporting side (for now at least).
> I'm looking at the modules and trying to see which can actually do
> reporting, and which are functionally implementing limits on the bandwidth.
> Is anyone else doing this type of thing now?
> 
> 
> Best Regards,
> 
> 
> Steve Leach
> IT/Network Manager
> MI International Ltd
> 
> ----- Original Message -----
> From: "Porter, Mark" <Mark.Porter@LibertyMutual.com>
> To: <users@httpd.apache.org>
> Sent: Monday, November 25, 2002 2:48 PM
> Subject: RE: [users@httpd] Apache Bandwidth Utilization / Reporting
> 
> 
> 
>>Aren't you describing mod_throttle? I personally have never used it, but
>>in the cursory glance I gave the module description, it sounds like it
>>may be what you're looking for.
>>
>>
>>
>>-----Original Message-----
>>From: Sander Holthaus - Orange XL [mailto:info@orangexl.com]
>>Sent: Monday, November 25, 2002 9:57 AM
>>To: users@httpd.apache.org
>>Subject: Re: [users@httpd] Apache Bandwidth Utilization / Reporting
>>
>>
>>Personally, I think such a feature should be implemented in Apache for a
>>very basic protection against (D)DoS-attacks. So you can set things like
>>MaxBandwith (per day/hour) or MaxPeakBandwith on a per server and
>>per-virtual-host basis.
>>
>>Imagine what could happen if you are away for a few hours and someone
>>decides to fill up your connection with HTTP-requests. Such attacks are
>>becoming more frequent, and put a severe strain on not only the websever
>>itself, but also servers and networkcomponents around it. Not to mention
>>economic damages...
>>
>>Anyone any thoughts on this?
>>
>>Kind Regards,
>>Sander Holthaus
>>
>>----- Original Message -----
>>From: "Steve Leach" <steve.leach@mi-int.com>
>>To: <users@httpd.apache.org>
>>Sent: Monday, November 25, 2002 10:57 AM
>>Subject: [users@httpd] Apache Bandwidth Utilization / Reporting
>>
>>
>>
>>>Group,
>>>
>>>Is there a module for Apache 1.x or 2.x (new server so I have the
>>
>>option
>>to
>>
>>>choose!!!), that will allow me to see what the cumulative bandwidth
>>
>>usage
>>is
>>
>>>for (a) individual Virtual Hosts and (b) the Apache Server as a whole?
>>
>>I
>>
>>>would like to be able to produce  adaily report that includes this
>>>information in a formal bandwidth costing exercise.
>>>
>>>If there is no feature (or module) for Apache, is there a product
>>
>>thatanyone
>>
>>>can recommend that will provide such functionality.
>>>
>>>Thanks in advance.
>>>
>>>
>>>Best Regards,
>>>
>>>
>>>Steve Leach
>>>IT / Network Manager
>>>MI International Ltd
>>>


---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org