httpd-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joshua Slive <jos...@slive.ca>
Subject Re: 2.1.10-worker core dumps on minotaur
Date Tue, 22 Nov 2005 20:11:40 GMT

Paul Querna wrote:
> Joshua Slive wrote:
>> I've already posted this on infrastructure@, but I thought I should
>> mention it here as well because it might have an effect on the release
>> decision.  We have at least 3 core dumps from 2.1.10 on minotaur.  They
>> are in /x1/coredumps, but none seem debuggable.  This might have to do
>> with them getting truncated writing to a full filesystem, but we won't
>> know until we get another one.
>>
>> It is important to note that this is the first time we've run worker on
>> minotaur (freebsd).  So it may still be a freebsd threading issue.  I
>> don't know.
> 
> I just ran strings on the two non-Zero-byte core files.
> 
> Both of those are for cvs.apache.org, not www.apache.org.  I would guess
> its some issue with subversion that is causing it to go off into la la
> land, and it isn't a problem with the 2.1.10 candidate.

Ahhh... Good idea.  I had just assumed based on the size of the dump 
that it had to be the threaded server.  But obviously svn requests are 
sometimes memory hungry as well.  I've appended the backtrace bellow 
(which is easy to get when you use the proper httpd), and yes it does 
seem to be in subversion.


#0  0x2840b777 in kill () from /lib/libc.so.5
#1  0x2840081e in raise () from /lib/libc.so.5
#2  0x2847415b in abort () from /lib/libc.so.5
#3  0x284f651c in abort_on_pool_failure (retcode=12)
     at ../../svn-current/subversion/libsvn_subr/pool.c:46
#4  0x28396bc4 in apr_palloc (pool=0x8120018, size=16)
     at 
/x2/home/jerenkrantz/httpd-2.2/srclib/apr/memory/unix/apr_pools.c:618
#5  0x284fbecc in get_xlate_handle_node (ret=0xbfbfd790,
     topage=0x1 <Address 0x1 out of bounds>, frompage=0x2850588c "UTF-8",
     userdata_key=0x28505892 "svn-utf-uton-xlate-handle", pool=0x8120018)
     at ../../svn-current/subversion/libsvn_subr/utf.c:203
#6  0x284fc1d1 in get_uton_xlate_handle_node (ret=0xbfbfd790, 
pool=0x1e1a2018)
     at ../../svn-current/subversion/libsvn_subr/utf.c:318
#7  0x284fcf96 in svn_utf_cstring_from_utf8 (dest=0xbfbfd7f0,
     src=0x1e1a2078 "/x1/svn/asf/db/revs/19156", pool=0x1e1a2018)
     at ../../svn-current/subversion/libsvn_subr/utf.c:752
#8  0x284f63b1 in svn_path_cstring_from_utf8 (path_apr=0xbfbfd7f0,
     path_utf8=0x1e1a2078 "/x1/svn/asf/db/revs/19156", pool=0x1e1a2018)
     at ../../svn-current/subversion/libsvn_subr/path.c:1233
#9  0x284f1785 in svn_io_file_open (new_file=0xbfbfd830,
     fname=0x1e1a2078 "/x1/svn/asf/db/revs/19156", flag=129, perm=4095,
     pool=0x1e1a2018) at ../../svn-current/subversion/libsvn_subr/io.c:2120
#10 0x28518a4d in open_and_seek_revision (file=0xbfbfd894, fs=0x8ce1028,
     rev=19156, offset=812492, pool=0x1e1a2018)
     at ../../svn-current/subversion/libsvn_fs_fs/fs_fs.c:495
#11 0x28518b6f in open_and_seek_representation (file_p=0xbfbfd894,
     fs=0x8ce1028, rep=0xbfbfd8a0, pool=0x1e1a2018)
     at ../../svn-current/subversion/libsvn_fs_fs/fs_fs.c:541
#12 0x2851a7e3 in build_rep_list (list=0xd9e948c, src_state=0xd9e9490,
     fs=0x8ce1028, first_rep=0xd9e9298, pool=0x1e1a2018)
     at ../../svn-current/subversion/libsvn_fs_fs/fs_fs.c:1253
#13 0x2851aafe in rep_read_get_baton (rb_p=0xbfbfd950, fs=0x8ce1028,
     rep=0xd9e9298, pool=0xa78d018)
     at ../../svn-current/subversion/libsvn_fs_fs/fs_fs.c:1358
#14 0x2851b792 in read_representation (contents_p=0xbfbfd980, fs=0x8ce1028,
     rep=0xd9e9298, pool=0xa78d018)
     at ../../svn-current/subversion/libsvn_fs_fs/fs_fs.c:1670
#15 0x2851b947 in get_dir_contents (entries=0xd9e9420, fs=0x8ce1028,
---Type <return> to continue, or q <return> to quit---
     noderev=0xd9e9230, pool=0xa78d018)
     at ../../svn-current/subversion/libsvn_fs_fs/fs_fs.c:1717
#16 0x2851ba2c in svn_fs_fs__rep_contents_dir (entries_p=0xbfbfda40,
     fs=0x8ce1028, noderev=0xd9e9230, pool=0xa78d018)
     at ../../svn-current/subversion/libsvn_fs_fs/fs_fs.c:1744
#17 0x285158b0 in svn_fs_fs__dag_dir_entries (entries=0xbfbfda40,
     node=0x87cb760, pool=0xa78d018)
     at ../../svn-current/subversion/libsvn_fs_fs/dag.c:438
#18 0x28515499 in dir_entry_id_from_node (id_p=0xbfbfda70, parent=0x87cb760,
     name=0xd9e93b0 "excalibur", pool=0xa78d018)
     at ../../svn-current/subversion/libsvn_fs_fs/dag.c:320
#19 0x28516859 in svn_fs_fs__dag_open (child_p=0xbfbfdaa8, parent=0x87cb760,
     name=0xd9e93b0 "excalibur", pool=0xa78d018)
     at ../../svn-current/subversion/libsvn_fs_fs/dag.c:991
#20 0x285249ad in open_path (parent_path_p=0xbfbfdb3c, root=0xa2ec050,
     path=0x1e20c410 
"/excalibur/tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org/apache/avalon/excalibur/monitor/MonitorableURLSource.java",
     flags=0, txn_id=0x0, pool=0xa78d018)
     at ../../svn-current/subversion/libsvn_fs_fs/tree.c:706
#21 0x28527c79 in history_prev (baton=0xbfbfdba0, pool=0xa78d018)
     at ../../svn-current/subversion/libsvn_fs_fs/tree.c:2824
#22 0x285280c1 in fs_history_prev (prev_history_p=0xbfbfdc10,
     history=0x1e20c498, cross_copies=0, pool=0xa78d018)
     at ../../svn-current/subversion/libsvn_fs_fs/tree.c:2982
#23 0x284d693b in svn_fs_history_prev (prev_history_p=0xbfbfdc10,
     history=0x1e20c498, cross_copies=0, pool=0xa78d018)
     at ../../svn-current/subversion/libsvn_fs/fs-loader.c:943
#24 0x284ac22a in get_last_history_rev (revision=0xbfbfdc4c, root=0xa326050,
     path=0xa78d378 
"/excalibur/tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org/apache/avalon/excalibur/monitor/MonitorableURLSource.java",
     pool=0xa78d018)
     at 
/x2/home/jerenkrantz/build/svn-current-1/../../svn-current/subversion/mod_dav_svn/util.c:92
#25 0x284ac2de in dav_svn_get_safe_cr (root=0xa326050,
     path=0xa78d378 
"/excalibur/tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org/apache/avalon/excalibur/monitor/MonitorableURLSource.java",
     pool=0xa78d018)
     at 
/x2/home/jerenkrantz/build/svn-current-1/../../svn-current/subversion/mod---Type 
<return> to continue, or q <return> to quit---
_dav_svn/util.c:116
#26 0x284a9c82 in send_vsn_url (baton=0xa78d290, pool=0xa78d018)
     at 
/x2/home/jerenkrantz/build/svn-current-1/../../svn-current/subversion/mod_dav_svn/update.c:365
#27 0x284aa0dd in add_helper (is_dir=0,
     path=0xa78d050 
"tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org/apache/avalon/excalibur/monitor/MonitorableURLSource.java",

parent=0x8806220,
     copyfrom_path=0x0, copyfrom_revision=-1, pool=0xa78d018,
     child_baton=0xbfbfdd80)
     at 
/x2/home/jerenkrantz/build/svn-current-1/../../svn-current/subversion/mod_dav_svn/update.c:506
#28 0x284aac9e in upd_add_file (
     path=0xa78d050 
"tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org/apache/avalon/excalibur/monitor/MonitorableURLSource.java",
     parent_baton=0x8806220, copyfrom_path=0x0, copyfrom_revision=-1,
     pool=0xa78d018, file_baton=0xbfbfdd80)
     at 
/x2/home/jerenkrantz/build/svn-current-1/../../svn-current/subversion/mod_dav_svn/update.c:863
#29 0x284c650e in update_entry (b=0x823e318, s_rev=345918, s_path=0x0,
     s_entry=0x0,
     t_path=0xa78d0c8 
"/excalibur/tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org/apache/avalon/excalibur/monitor/MonitorableURLSource.java",
     t_entry=0x8cb4a88, dir_baton=0x8806220,
     e_path=0xa78d050 
"tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org/apache/avalon/excalibur/monitor/MonitorableURLSource.java",

info=0x0,
     recurse=1, pool=0xa78d018)
     at ../../svn-current/subversion/libsvn_repos/reporter.c:729
#30 0x284c6a46 in delta_dirs (b=0x823e318, s_rev=345918, s_path=0x0,
     t_path=0x88060b0 
"/excalibur/tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org/apache/avalon/excalibur/monitor",

dir_baton=0x8806220,
     e_path=0x8806050 
"tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org/apache/avalon/excalibur/monitor",

start_empty=0, pool=0x8806018)
     at ../../svn-current/subversion/libsvn_repos/reporter.c:857
#31 0x284c647e in update_entry (b=0x823e318, s_rev=345918, s_path=0x0,
     s_entry=0x0,
     t_path=0x88060b0 
"/excalibur/tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org/apache/avalon/excalibur/monitor",

t_entry=0x8916740,
     dir_baton=0xa6be200,
---Type <return> to continue, or q <return> to quit---
     e_path=0x8806050 
"tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org/apache/avalon/excalibur/monitor",

info=0x0, recurse=1, pool=0x8806018)
     at ../../svn-current/subversion/libsvn_repos/reporter.c:719
#32 0x284c6a46 in delta_dirs (b=0x823e318, s_rev=345918, s_path=0x0,
     t_path=0xa6be0a8 
"/excalibur/tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org/apache/avalon/excalibur",

dir_baton=0xa6be200,
     e_path=0xa6be050 
"tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org/apache/avalon/excalibur", 
start_empty=0, pool=0xa6be018)
     at ../../svn-current/subversion/libsvn_repos/reporter.c:857
#33 0x284c647e in update_entry (b=0x823e318, s_rev=345918, s_path=0x0,
     s_entry=0x0,
     t_path=0xa6be0a8 
"/excalibur/tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org/apache/avalon/excalibur",

t_entry=0x1e1ad738,
     dir_baton=0xc9d31d8,
     e_path=0xa6be050 
"tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org/apache/avalon/excalibur", 
info=0x0, recurse=1, pool=0xa6be018)
     at ../../svn-current/subversion/libsvn_repos/reporter.c:719
#34 0x284c6a46 in delta_dirs (b=0x823e318, s_rev=345918, s_path=0x0,
     t_path=0xc9d30a0 
"/excalibur/tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org/apache/avalon", 
dir_baton=0xc9d31d8,
     e_path=0xc9d3050 
"tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org/apache/avalon", 
start_empty=0, pool=0xc9d3018)
     at ../../svn-current/subversion/libsvn_repos/reporter.c:857
#35 0x284c647e in update_entry (b=0x823e318, s_rev=345918, s_path=0x0,
     s_entry=0x0,
     t_path=0xc9d30a0 
"/excalibur/tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org/apache/avalon", 
t_entry=0x8ce3720, dir_baton=0x8e6f1c0,
     e_path=0xc9d3050 
"tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org/apache/avalon", 
info=0x0, recurse=1, pool=0xc9d3018)
     at ../../svn-current/subversion/libsvn_repos/reporter.c:719
#36 0x284c6a46 in delta_dirs (b=0x823e318, s_rev=345918, s_path=0x0,
     t_path=0x8e6f098 
"/excalibur/tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org/apache", 
dir_baton=0x8e6f1c0,
     e_path=0x8e6f050 
"tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org/apache", 
start_empty=0, pool=0x8e6f018)
     at ../../svn-current/subversion/libsvn_repos/reporter.c:857
#37 0x284c647e in update_entry (b=0x823e318, s_rev=345918, s_path=0x0,
     s_entry=0x0,
---Type <return> to continue, or q <return> to quit---
     t_path=0x8e6f098 
"/excalibur/tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org/apache", 
t_entry=0xca66710, dir_baton=0x9fa51a0,
     e_path=0x8e6f050 
"tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org/apache", 
info=0x0, recurse=1, pool=0x8e6f018)
     at ../../svn-current/subversion/libsvn_repos/reporter.c:719
#38 0x284c6a46 in delta_dirs (b=0x823e318, s_rev=345918, s_path=0x0,
     t_path=0x9fa5090 
"/excalibur/tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org", 
dir_baton=0x9fa51a0,
     e_path=0x9fa5050 
"tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org", 
start_empty=0, pool=0x9fa5018)
     at ../../svn-current/subversion/libsvn_repos/reporter.c:857
#39 0x284c647e in update_entry (b=0x823e318, s_rev=345918, s_path=0x0,
     s_entry=0x0,
     t_path=0x9fa5090 
"/excalibur/tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org", 
t_entry=0xda1f700, dir_baton=0x909c198,
     e_path=0x9fa5050 
"tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java/org", 
info=0x0, recurse=1, pool=0x9fa5018)
     at ../../svn-current/subversion/libsvn_repos/reporter.c:719
#40 0x284c6a46 in delta_dirs (b=0x823e318, s_rev=345918, s_path=0x0,
     t_path=0x909c090 
"/excalibur/tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java", 
dir_baton=0x909c198,
     e_path=0x909c050 
"tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java", 
start_empty=0, pool=0x909c018)
     at ../../svn-current/subversion/libsvn_repos/reporter.c:857
#41 0x284c647e in update_entry (b=0x823e318, s_rev=345918, s_path=0x0,
     s_entry=0x0,
     t_path=0x909c090 
"/excalibur/tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java", 
t_entry=0x8789900, dir_baton=0x8cfc180,
     e_path=0x909c050 
"tags/Excalibur-Initial-Cleanup-Complete/monitor/src/java", info=0x0, 
recurse=1, pool=0x909c018)
     at ../../svn-current/subversion/libsvn_repos/reporter.c:719
#42 0x284c6a46 in delta_dirs (b=0x823e318, s_rev=345918, s_path=0x0,
     t_path=0x8cfc088 
"/excalibur/tags/Excalibur-Initial-Cleanup-Complete/monitor/src", 
dir_baton=0x8cfc180,
     e_path=0x8cfc050 "tags/Excalibur-Initial-Cleanup-Complete/monitor/src",
     start_empty=0, pool=0x8cfc018)
     at ../../svn-current/subversion/libsvn_repos/reporter.c:857
#43 0x284c647e in update_entry (b=0x823e318, s_rev=345918, s_path=0x0,
---Type <return> to continue, or q <return> to quit---
     s_entry=0x0,
     t_path=0x8cfc088 
"/excalibur/tags/Excalibur-Initial-Cleanup-Complete/monitor/src", 
t_entry=0xa724288, dir_baton=0xa286170,
     e_path=0x8cfc050 "tags/Excalibur-Initial-Cleanup-Complete/monitor/src",
     info=0x0, recurse=1, pool=0x8cfc018)
     at ../../svn-current/subversion/libsvn_repos/reporter.c:719
#44 0x284c6a46 in delta_dirs (b=0x823e318, s_rev=345918, s_path=0x0,
     t_path=0xa286080 
"/excalibur/tags/Excalibur-Initial-Cleanup-Complete/monitor", 
dir_baton=0xa286170,
     e_path=0xa286050 "tags/Excalibur-Initial-Cleanup-Complete/monitor",
     start_empty=0, pool=0xa286018)
     at ../../svn-current/subversion/libsvn_repos/reporter.c:857
#45 0x284c647e in update_entry (b=0x823e318, s_rev=345918, s_path=0x0,
     s_entry=0x0,
     t_path=0xa286080 
"/excalibur/tags/Excalibur-Initial-Cleanup-Complete/monitor", 
t_entry=0x8281450, dir_baton=0x8556150,
     e_path=0xa286050 "tags/Excalibur-Initial-Cleanup-Complete/monitor",
     info=0x0, recurse=1, pool=0xa286018)
     at ../../svn-current/subversion/libsvn_repos/reporter.c:719
#46 0x284c6a46 in delta_dirs (b=0x823e318, s_rev=345918, s_path=0x0,
     t_path=0x8556078 "/excalibur/tags/Excalibur-Initial-Cleanup-Complete",
     dir_baton=0x8556150,
     e_path=0x8556050 "tags/Excalibur-Initial-Cleanup-Complete", 
start_empty=0,
     pool=0x8556018) at 
../../svn-current/subversion/libsvn_repos/reporter.c:857
#47 0x284c647e in update_entry (b=0x823e318, s_rev=345918, s_path=0x0,
     s_entry=0x0,
     t_path=0x8556078 "/excalibur/tags/Excalibur-Initial-Cleanup-Complete",
     t_entry=0x8303bf8, dir_baton=0x82c80c0,
     e_path=0x8556050 "tags/Excalibur-Initial-Cleanup-Complete", info=0x0,
     recurse=1, pool=0x8556018)
     at ../../svn-current/subversion/libsvn_repos/reporter.c:719
#48 0x284c6a46 in delta_dirs (b=0x823e318, s_rev=345918, s_path=0x0,
     t_path=0x82c8058 "/excalibur/tags", dir_baton=0x82c80c0,
     e_path=0x82c8050 "tags", start_empty=0, pool=0x82c8018)
     at ../../svn-current/subversion/libsvn_repos/reporter.c:857
#49 0x284c647e in update_entry (b=0x823e318, s_rev=345918, s_path=0x0,
     s_entry=0x0, t_path=0x82c8058 "/excalibur/tags", t_entry=0x8285a20,
     dir_baton=0x83ad3a8, e_path=0x82c8050 "tags", info=0x0, recurse=1,
---Type <return> to continue, or q <return> to quit---
     pool=0x82c8018) at 
../../svn-current/subversion/libsvn_repos/reporter.c:719
#50 0x284c6a46 in delta_dirs (b=0x823e318, s_rev=345918,
     s_path=0x8a51328 "/excalibur", t_path=0x823e388 "/excalibur",
     dir_baton=0x83ad3a8, e_path=0x284cb673 "", start_empty=1, 
pool=0x8598018)
     at ../../svn-current/subversion/libsvn_repos/reporter.c:857
#51 0x284c6d34 in drive (b=0x823e318, s_rev=345918, info=0x9c78018,
     pool=0x8598018) at 
../../svn-current/subversion/libsvn_repos/reporter.c:913
#52 0x284c708a in finish_report (b=0x823e318, pool=0x8598018)
     at ../../svn-current/subversion/libsvn_repos/reporter.c:974
#53 0x284c72f3 in svn_repos_finish_report (baton=0x823e318, pool=0x8598018)
     at ../../svn-current/subversion/libsvn_repos/reporter.c:1050
#54 0x284abe0d in dav_svn__update_report (resource=0x8c955e8, doc=0x8c95308,
     output=0x8598de8)
     at 
/x2/home/jerenkrantz/build/svn-current-1/../../svn-current/subversion/mod_dav_svn/update.c:1368
#55 0x284aecdd in dav_svn_deliver_report (r=0x8598050, resource=0x8c955e8,
     doc=0x8c95308, output=0x8598de8)
     at 
/x2/home/jerenkrantz/build/svn-current-1/../../svn-current/subversion/mod_dav_svn/version.c:1342
#56 0x080bc5ff in dav_method_report (r=0x8598050)
     at /x2/home/jerenkrantz/httpd-2.2/modules/dav/main/mod_dav.c:4060
#57 0x080bd5f7 in dav_handler (r=0x8598050)
     at /x2/home/jerenkrantz/httpd-2.2/modules/dav/main/mod_dav.c:4696
#58 0x08079c6e in ap_run_handler (r=0x8598050)
     at /x2/home/jerenkrantz/httpd-2.2/server/config.c:157
#59 0x0807a3ee in ap_invoke_handler (r=0x8598050)
     at /x2/home/jerenkrantz/httpd-2.2/server/config.c:371
#60 0x080b0108 in ap_process_request (r=0x8598050)
     at /x2/home/jerenkrantz/httpd-2.2/modules/http/http_request.c:258
#61 0x080ad56f in ap_process_http_connection (c=0x822f128)
     at /x2/home/jerenkrantz/httpd-2.2/modules/http/http_core.c:172
#62 0x08081322 in ap_run_process_connection (c=0x822f128)
     at /x2/home/jerenkrantz/httpd-2.2/server/connection.c:43
#63 0x0808171c in ap_process_connection (c=0x822f128, csd=0x822f050)
     at /x2/home/jerenkrantz/httpd-2.2/server/connection.c:176
#64 0x080d8732 in child_main (child_num_arg=15)
     at /x2/home/jerenkrantz/httpd-2.2/server/mpm/prefork/prefork.c:626
#65 0x080d88cf in make_child (s=0x81c31c0, slot=15)
---Type <return> to continue, or q <return> to quit---
     at /x2/home/jerenkrantz/httpd-2.2/server/mpm/prefork/prefork.c:722
#66 0x080d8b2e in perform_idle_server_maintenance (p=0x8114018)
     at /x2/home/jerenkrantz/httpd-2.2/server/mpm/prefork/prefork.c:857
#67 0x080d8fa4 in ap_mpm_run (_pconf=0x8114018, plog=0x815c018, s=0x81c31c0)
     at /x2/home/jerenkrantz/httpd-2.2/server/mpm/prefork/prefork.c:1061
#68 0x080650e2 in main (argc=3, argv=0xbfbfee20)
     at /x2/home/jerenkrantz/httpd-2.2/server/main.c:704


Mime
View raw message