httpd-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dan Trainor <...@v2web.com>
Subject Re: [users@httpd] Keeping multiple logs in central location
Date Wed, 17 May 2006 18:33:25 GMT
Brian Rectanus wrote:
> mod_log_spread is great, but what I have also done in the past is to
> use cronolog as a pipe to place logs into
> .../hostname/YYYY/MM/DD/hh-access_log.  Then run a cron job from your
> stats server to move the files onto the stats server that are >1h old
> (ie rotated), merge them with the other machines' logs, then run
> stats.  That works well, and tends to not have issues if spread fails.
> rsync pull over ssh tunnel from a read-only user (with no other
> rights) works for the copies.
> 
> -B
> 
> On 5/16/06, David Salisbury <salisbury@globe.gov> wrote:
> 
>> try looking into
>>
>> http://www.backhand.org/mod_log_spread/
>>
>> -Dave
>>
>>
>> ----- Original Message -----
>> From: "Dan Trainor" <dan@v2web.com>
>> To: <users@httpd.apache.org>
>> Sent: Tuesday, May 16, 2006 2:47 PM
>> Subject: [users@httpd] Keeping multiple logs in central location
>>
>>
>> > Hello, all -
>> >
>> > I've browsed the archives a bit, but have not been able to come up with
>> > a good solution, so I'll go ahead and ask.
>> >
>> > We've got quite a few webservers, on which we're comfortable using
>> > AWStats.  The server pool is part of a load balance cluster, and it's
>> > very difficult to generate statistics on the data as a whole - rather,
>> > we're generating statistics based on several different servers.
>> >
>> > What I guess I'm looking for here is a way to keep all my Apache 
>> logs in
>> > a central location, where I can run stats for the total of the pool.
>> >
>> > A while ago, I used mod_log_mysql to store all logs in a SQL database.
>> > While this worked, it was difficult to extract the data from the
>> > database and parse that for something like AWStats.  Besides, this was
>> > very slow.
>> >
>> > I think that if I was able to manage logs and keep them in one 
>> location,
>> > I could take it from there and find something to run statistics against
>> > the logs which might be more "friendly".
>> >
>> > If anyone has any experience in this, I would greatly appreciate it.
>> >
>> > Thanks
>> > -dant
>> >

Hello, Brian -

This sounds like one of the most appealing solutions, I guess.

Anyone have any feedback on mod_log_mysql in an env where one site is 
getting a lot of traffic?  I'd enjoy this approach, but understand that 
it carries a lot of overhead.

Thanks
-dant

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Mime
View raw message