httpd-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Paul J. Reder" <rede...@raleigh.ibm.com>
Subject Re: 2.0.23?
Date Wed, 01 Aug 2001 18:00:17 GMT
Ok, I have run a cvs head build of 2.0.23 (as of Tuesday at 4:30) for 2.75 
hours with the following config and results. The synopsis is that it 
ran well until it died.

Config:
  Server: (with a mirror of apache.org stored locally)
     Linux box with 384 MB of memory and 30 GB HD running threaded mpm with
        the apache.org httpd.conf with the following mpm config values.
        StartServers        3
        MaxClients          10
        MinSpareThreads     150
        MaxSpareThreads     300
        ThreadsPerChild     50
        MaxRequestsPerChild 3000
     Built with a copy of the config.nice from apache.org.

  Clients, 18 copies of b running on 7 machines with the following parms:
        ./b -c 100 -n 120000 -f replay.list -v 
     where replay.list is an actual access_log from apache.org. All of these
     machines have /etc/hosts files pointing all the apache.org urls at my
     local server.

  All machines are on a local ethernet switch with no other traffic. The server
     is on a 100 Mbps connection. All connections are full duplex.

Results:______________________________________________________________________

There was a great deal of churning during the initial 10 minutes of the
abuse run. It would start a bunch of processes, but find there were too
many idle workers the next time around and kill some. Then the new workers
will have had a chance to catch requests and there were too few idle 
workers the next time around... It eventually settled down with a pretty
steady average of about 300 workers and 100 processes (I checked ps -efH |
grep httpd | count_procs at regular intervals).

At the 1 hour mark...
==================================================
Current Time: Wednesday, 01-Aug-2001 09:09:15 EDT
Restart Time: Wednesday, 01-Aug-2001 08:09:19 EDT
Parent Server Generation: 0
Server uptime: 59 minutes 56 seconds
Total accesses: 1010248 - Total Traffic: 25.8 GB
CPU Usage: u22.56 s91.53 cu0 cs.01 - 3.17% CPU load
281 requests/sec - 7.3 MB/second - 26.8 kB/request
498 requests currently being processed, 1 idle workers
 
WWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWW
RWWWWWWWWRWWWWRWWWWWWWWWWWWWWWRRRWW.WWWWWWWWWWWRWWWWWWWWWRWWWWWW
WRWWRWWRWWWRWWWWWWWWWWRWWRRWWWWWRWWRWWWWWWWWWWWRWWWWWWRWWWWWWRWR
WWWWWWRWWRWWWWWWWWWWRWWWWWWWWWRWWWWWWWRWWWWWRWWWWWWWWWWWRWWRWWWW
WKWWWWWWWRRWWWWW_WWRRWRWWWWWWWWWWRWWWWRWWWWRWRWWWWWWWWWRWWWWWWWR
WWWWWWWRRWWWWWRWWWWWWRWWWWWRWWWWWRWWWRRWRWWWWWWWRWWWRWWWRWWRWWWW
WWWWWWWWWWWWWWRWWRWWWWWWWWWWWWWWWWWWWWWWWWWWWRWWWWRWRWWWWWWRWWRR
WWWWWRWWWWWWWWWWWRWWWWWWWWWWWWWWWWWWWWWWWWWWWRWWWWWW............

It started serving pages at a rate of about 350 rps and continued
to decrease throughout the first 1.25 hours until it had reached
a low value of about 195 rps. In part this decrease corresponded
to the occurance of large file requests until the average number
of concurrent large file requests had been reached. At this point
it seemed to reach a balanced state and began to rise slightly
over the next hour.

At the 2 hour mark...
==================================================
Current Time: Wednesday, 01-Aug-2001 10:09:24 EDT
Restart Time: Wednesday, 01-Aug-2001 08:09:19 EDT
Parent Server Generation: 0
Server uptime: 2 hours 5 seconds
Total accesses: 1532679 - Total Traffic: 48.3 GB
CPU Usage: u32.13 s44.79 cu.3 cs2.53 - 1.11% CPU load
213 requests/sec - 6.9 MB/second - 33.0 kB/request
324 requests currently being processed, 8 idle workers
 
WWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWW.R.W.....R.WR.
.R.RWWRRWRWR..WW.RW.WWR...G...SWS...W_WWWWRWR.WRWRWRWR_SSGW..W.R
R.WW..RW....W..R......WRWSWWWWWWWWSWWW.W.WWWWWG...RWWRWW.WW....S
S.......W_WRWW__W_WW_SWSR.WRG.W...W.W.WRW.....W.......R...RRRRRR
WKWWWWRWRWWRRWWS_SWR.WRW.W.W.W.....W.....SS.WW.WRWWWRWWWWW.WWWWW
WRWWWWWWSW..W.......W..W.......WWWWWWWWWWWWRWWKSWWWS.WW....W...W
WW......WW.....WW.WW..WRWWWWWWRWRRWWWWRR.WWRW.WW.WWWWWWWWWWWWRRW
WRRWWSSWW.WGWW......WWW.WW..WW...W.....W..W.W.W.W...............

The server continued to slowly improve the rps value until it died.
The last status I caught was actually a couple of minutes after 
the death of the main Apache. The kids continued serving pages for
a few minutes after Apache exited.

At about the 2.75 hour mark... 
==================================================
Current Time: Wednesday, 01-Aug-2001 10:48:54 EDT
Restart Time: Wednesday, 01-Aug-2001 08:09:19 EDT
Parent Server Generation: 0
Server uptime: 2 hours 39 minutes 35 seconds
Total accesses: 2259384 - Total Traffic: 63.1 GB
CPU Usage: u31.79 s96.78 cu0 cs.06 - 1.34% CPU load
236 requests/sec - 6.8 MB/second - 29.3 kB/request
190 requests currently being processed, 0 idle workers
 
WWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWWW.WWW..WW.WWW
W.WWG..WW..W.....WWW.WWW.WW.W..W....._.....R.W.W.WWW...WW.WWWW..
....W.WW.WW.W.G....W..W.W.RR.WWWW.WR..WW.WWWWWW.WRWWWWSW..GW....
........WW..W.R..WWW..W.WWW.W..W.WW.WW.WW..WWW..WWWWWWS.....WW.W
WK.W.W.W..WW.W.._..R.WR.WW.WG.WW.W.WW..WW.W...W.W...WWW..WW.W.WW
W.W.W..W...W..R..W....W.G....WRW.RR...WWW..WW.WWWWRWW....WWR.WWW
W..WW.WWRRWW.WS.WWRRWWWWRRRWWWRWWWRRWWWWWRWWRWWWWRRWRRWRWRWWWWWW
WW...W.W.W..WW..WWGWW.WWWWWW.W.WW..WWW..W....W..W.W.............

About 3 minutes after this, Apache stopped serving pages.

The interesting portion of the error_log:
-----------------------------------------
[Wed Aug 01 08:10:23 2001] [error] server reached MaxClients setting,
                                   consider raising the MaxClients setting
[Wed Aug 01 08:15:28 2001] [notice] child pid 5846 exit signal Segmentation fault (11)
[Wed Aug 01 08:15:41 2001] [notice] child pid 6157 exit signal Segmentation fault (11)
[Wed Aug 01 08:27:09 2001] [notice] child pid 14585 exit signal Segmentation fault (11)
[Wed Aug 01 08:29:11 2001] [notice] child pid 15484 exit signal Segmentation fault (11)
[Wed Aug 01 09:51:11 2001] [notice] child pid 27771 exit signal Segmentation fault (11)
[Wed Aug 01 10:01:39 2001] [notice] child pid 31783 exit signal Segmentation fault (11)
[Wed Aug 01 10:05:42 2001] [notice] child pid 1529 exit signal Segmentation fault (11)
[Wed Aug 01 10:07:59 2001] [notice] child pid 3102 exit signal Segmentation fault (11)
[Wed Aug 01 10:46:39 2001] [alert] (12)Cannot allocate memory: apr_thread_create:
                                       unable to create worker thread
[Wed Aug 01 10:46:39 2001] [alert] (12)Cannot allocate memory: apr_thread_create:
                                       unable to create worker thread
[Wed Aug 01 10:46:39 2001] [alert] (12)Cannot allocate memory: apr_thread_create:
                                       unable to create worker thread
[Wed Aug 01 10:46:49 2001] [alert] Child 19225 returned a Fatal error... 

At this point Apache stopped serving pages (duh). There was no core file (since
Apache didn't dump it just exited). There were no core files from the segfaults either.
I have received core files recently, but I can't pin my finger on why I do or
don't get them.

-- 
Paul J. Reder
-----------------------------------------------------------
"The strength of the Constitution lies entirely in the determination of each
citizen to defend it.  Only if every single citizen feels duty bound to do
his share in this defense are the constitutional rights secure."
-- Albert Einstein

Mime
View raw message