httpd-bugs mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bugzi...@apache.org
Subject DO NOT REPLY [Bug 50280] New: apache coredumps under load
Date Tue, 16 Nov 2010 19:10:58 GMT
https://issues.apache.org/bugzilla/show_bug.cgi?id=50280

           Summary: apache coredumps under load
           Product: Apache httpd-2
           Version: 2.2.15
          Platform: Sun
        OS/Version: Solaris
            Status: NEW
          Severity: critical
          Priority: P2
         Component: Core
        AssignedTo: bugs@httpd.apache.org
        ReportedBy: mike.pechkin@gmail.com


Server: Solaris 10u3 + 10Recommended (6.10.2010)
Soft: Apache 2.2.15 (compiled by Sun Studio 12 + latest patches)
Soft: openssl 0.9.8n from opencsw

This combination of soft coredumps 20+ times per day under load.
I can't repeat this in test bed.

I still believe they came from one source.
I see *several* types of crashes:

1.
# mdb core.httpd.5168
Loading modules: [ libc.so.1 libuutil.so.1 ld.so.1 ]
> ::stack
libc.so.1`_brk_unlocked+8(2000, ff035770, 700910, 7b6e8, 6fe910, dea89200)
libc.so.1`sbrk+0x24(2000, 6fd508, 7b728, fef57088, ff0303d8, ffffdfe7)
libc.so.1`_morecore+0xdc(2000, 6fd508, 6fe910, ff039338, 7ffffc00, 0)
libc.so.1`_malloc_unlocked+0x1fc(3000, 6fd508, 13f8, 6fd508, ff033a20, 0)
libc.so.1`malloc+0x4c(3000, 1, d95ac, ff1f0fd0, ff0303d8, ff03a5a0)
libapr-1.so.0`allocator_alloc+0x424(681b58, 2018, 1ac00, fe768ff8, aec98,
6fd4c8)
libapr-1.so.0`apr_palloc+0x120(681be0, 2018, fed0a6b8, fec9c384, 6a0b48,
fecd8e94)
mod_ssl.so`bio_filter_out_ctx_new+0x20(6823f8, 681ed0, 1ac00, fe768ff8, aec98,
6fd4c8)
mod_ssl.so`ssl_io_filter_init+0xc4(681ed0, 6a0b48, fed0a6b8, fec9c384, 6a0b48,
fecd8e94)
mod_ssl.so`ssl_init_ssl_connection+0x300(681ed0, 1ea, 6, 0, 681ed0, fed1f89c)
mod_ssl.so`ssl_hook_pre_connection+0x194(681ed0, 681c20, 681c20, 1f1, 681ec8,
687c88)
ap_run_pre_connection+0x7c(681ed0, 681c20, 0, 1f1, 687c88, 1)
ap_process_connection+0x24(681ed0, 681c20, 681c20, 1f1, 681ec8, 687c88)
process_socket+0xc4(681be0, 681c20, 0, 1f1, 687c88, 1)
worker_thread+0x2e0(480848, 23e058, 0, 0, 0, 0)
libapr-1.so.0`dummy_worker+0x24(480848, dd97c000, 0, 0, ff2084f8, 1)
libc.so.1`_lwp_start(0, 0, 0, 0, 0, 0)
> 

2.

# mdb core.httpd.3215
Loading modules: [ libc.so.1 libuutil.so.1 ld.so.1 ]
> ::stack
libc.so.1`_read+0xc(8, ffbff90b, 1, 0, ff035960, ff162a00)
ap_mpm_pod_check+0x30(153790, 6f038, 6fd68, 1c0430, 1c02e8, 250669)
child_main+0x3ec(1, 6e988, 0, 0, ff035960, ff162a00)
make_child+0x134(b1178, 1, 7, 0, b1178, 8ca94)
perform_idle_server_maintenance+0x61c(ffbffbb8, ffbffbb4, ffbffba0, af280, 0,
0)
server_main_loop+0x2c4(0, 6dd, 7, 0, b1178, 8ca94)
ap_mpm_run+0x3ec(af280, dd338, b1178, b1178, 0, 0)
main+0xe50(3, ffbffd6c, ffbffd7c, a0400, ff160100, 0)
_start+0x108(0, 0, 0, 0, 0, 0)
> 

3.

# mdb core.httpd.5550
Loading modules: [ libc.so.1 libuutil.so.1 ld.so.1 ]
> ::stack
libc.so.1`__lwp_park+0x14(dea8fa00, 0, ff033a20, 0, 1c00, 1d3c)
libc.so.1`free+0x1c(776138, 34, d871c, feca6550, ff0303d8, 67fbc8)
libcrypto.so.0.9.8`CRYPTO_free+0x48(0, 618, 400, fe768ff8, 127b40, 776138)
libssl.so.0.9.8`tls1_setup_key_block+0x128(65bab0, 34, 20, 776138, 14, 67fbc8)
libssl.so.0.9.8`ssl3_accept+0x6e0(65bab0, 21d0, fed0c518, 2000, 21d0, 67fbc8)
libssl.so.0.9.8`ssl23_get_client_hello+0x784(65bab0, b, 2210, 3, fecd6fa0,
dcc7b91c)
libssl.so.0.9.8`ssl23_accept+0x29c(65bab0, fed0c518, 0, 225e50, fecd6fa0, 2000)
mod_ssl.so`ssl_io_filter_connect+0x3a0(62fe40, 6a4bf0, 1, 0, 0, 0)
mod_ssl.so`ssl_io_filter_input+0x1a0(6a2de8, 6a4bf0, 1, 0, 0, 0)
ap_get_brigade+0x70(6a2de8, 6a4bf0, 1, 0, 0, 0)
ap_rgetline_core+0x90(6a3e60, 2000, dcc7bc44, 6a3e48, 0, 6a4bf0)
read_request_line+0x7c(6a3e48, 6a4bf0, ffffffff, 0, 0, 6a3ff1)
ap_read_request+0x224(62f918, 3, 0, 1fe, 6336a8, 1)
ap_process_http_connection+0x28(62f918, 62f668, 62f668, 3fe, 62f910, 6336a8)
ap_run_process_connection+0x74(62f918, 62f668, 1, 1fe, 6336a8, 1)
ap_process_connection+0x88(62f918, 62f668, 62f668, 3fe, 62f910, 6336a8)
process_socket+0xc4(62f628, 62f668, 1, 1fe, 6336a8, 1)
worker_thread+0x2e0(4809e8, 23e070, 0, 0, 0, 0)
libapr-1.so.0`dummy_worker+0x24(4809e8, dcc7c000, 0, 0, ff2084f8, 1)
libc.so.1`_lwp_start(0, 0, 0, 0, 0, 0)
> 

p.s. Next week I will deploy apache 2.2.17 + openssl 0.9.8o (opencsw) and
install latest kernel patch 144488-03

-- 
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: bugs-unsubscribe@httpd.apache.org
For additional commands, e-mail: bugs-help@httpd.apache.org


Mime
View raw message