Return-Path: Delivered-To: apmail-modperl-archive@apache.org Received: (qmail 10585 invoked by uid 500); 3 Oct 2002 18:27:13 -0000 Mailing-List: contact modperl-help@apache.org; run by ezmlm Precedence: bulk list-help: list-unsubscribe: list-post: Delivered-To: mailing list modperl@perl.apache.org Received: (qmail 10549 invoked from network); 3 Oct 2002 18:27:12 -0000 Message-ID: <3D9C8CA5.3030606@newsfactor.com> Date: Thu, 03 Oct 2002 11:29:57 -0700 From: dbohling@newsfactor.com User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.1) Gecko/20020826 X-Accept-Language: en-us, en MIME-Version: 1.0 To: modperl@perl.apache.org Subject: Backtraces on recurring segfaults on mod_perl-1.27/apache-1.3.26 Content-Type: multipart/mixed; boundary="------------040700020005000501060905" X-Spam-Rating: daedalus.apache.org 1.6.2 0/1000/N This is a multi-part message in MIME format. --------------040700020005000501060905 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit I've managed to get a couple of backtraces on a segfault problem we've been having for months now. The segfaults occur pretty rarely on the whole, but once a client triggers one on a particular page, they do not stop. The length and content of the request are key in making the segfaults happen. Modifying the cookie or adding characters to the request line causes the segfaults to stop. example (word wrapped): This request will produce a segfault (backtrace in attached gdb1.txt) and about 1/3 of the expected page : nc 192.168.1.20 84 GET /perl/section/entcmpt/ HTTP/1.1 User-Agent: Mozilla/5.0 (compatible; Konqueror/3; Linux 2.4.18-5) Pragma: no-cache Cache-control: no-cache Accept: text/*, image/jpeg, image/png, image/*, */* Accept-Encoding: x-gzip, gzip, identity Accept-Charset: iso-8859-1, utf-8;q=0.5, *;q=0.5 Accept-Language: en Host: 192.168.1.20:84 Cookie: mxstsn=1033666066:19573.19579.19572.19574.19577.19580.19576.19558.19560.19559.19557.19567.19566.19568.19544.19553.19545.19551.19554.19546.19548.19547.19532.19535.19533.19538.19534:0; Apache=192.168.2.1.124921033666065714 Adding a bunch of zeroes to the URI (which does not change the code functionality) causes the page to work correctly: nc 192.168.1.20 84 GET /perl/section/entcmpt/?00000000000000000000000000000000000000000000000000000000 HTTP/1.1 User-Agent: Mozilla/5.0 (compatible; Konqueror/3; Linux 2.4.18-5) Pragma: no-cache Cache-control: no-cache Accept: text/*, image/jpeg, image/png, image/*, */* Accept-Encoding: x-gzip, gzip, identity Accept-Charset: iso-8859-1, utf-8;q=0.5, *;q=0.5 Accept-Language: en Host: 192.168.1.20:84 Cookie: mxstsn=1033666066:19573.19579.19572.19574.19577.19580.19576.19558.19560.19559.19557.19567.19566.19568.19544.19553.19545.19551.19554.19546.19548.19547.19532.19535.19533.19538.19534:0; Apache=192.168.2.1.124921033666065714 Some info: /usr/apache-perl/bin/httpd -l Compiled-in modules: http_core.c mod_env.c mod_log_config.c mod_mime.c mod_negotiation.c mod_status.c mod_include.c mod_autoindex.c mod_dir.c mod_cgi.c mod_asis.c mod_imap.c mod_actions.c mod_userdir.c mod_alias.c mod_access.c mod_auth.c mod_so.c mod_setenvif.c mod_php4.c mod_perl.c Please forgive any obvious missing info (i'm not a c programmer). The first backtrace shows the segfault happening in mod_perl_sent_header(), and the second shows it happening in the ap_make_array() which was from Apache::Cookie. I don't have one handy now, but I've also seen it happen in ap_soft_timeout() after an XS_Apache_print (r->server was out of bounds). I've added a third backtrace where r->content_encoding contains the above 'mxstsn' cookie name. Any help would be greatly appreciated. -- -- Daniel Bohling NewsFactor Network --------------040700020005000501060905 Content-Type: text/plain; name="gdb1.txt" Content-Transfer-Encoding: 7bit Content-Disposition: inline; filename="gdb1.txt" [root@proxy dumps]# gdb /usr/apache-perl/bin/httpd core.12510 GNU gdb Red Hat Linux (5.2-2) Copyright 2002 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-redhat-linux"... Core was generated by `/usr/apache-perl/bin/httpd'. Program terminated with signal 11, Segmentation fault. Reading symbols from /lib/libpam.so.0...done. Loaded symbols for /lib/libpam.so.0 Reading symbols from /usr/lib/libmysqlclient.so.10...done. Loaded symbols for /usr/lib/libmysqlclient.so.10 Reading symbols from /lib/libcrypt.so.1...done. Loaded symbols for /lib/libcrypt.so.1 Reading symbols from /lib/libresolv.so.2...done. Loaded symbols for /lib/libresolv.so.2 Reading symbols from /lib/i686/libm.so.6...done. Loaded symbols for /lib/i686/libm.so.6 Reading symbols from /lib/libdl.so.2...done. Loaded symbols for /lib/libdl.so.2 Reading symbols from /lib/libnsl.so.1...done. Loaded symbols for /lib/libnsl.so.1 Reading symbols from /lib/i686/libc.so.6...bdone. Loaded symbols for /lib/i686/libc.so.6 Reading symbols from /lib/libutil.so.1...done. Loaded symbols for /lib/libutil.so.1 Reading symbols from /usr/lib/libexpat.so.0...done. Loaded symbols for /usr/lib/libexpat.so.0 Reading symbols from /usr/lib/libz.so.1...done. Loaded symbols for /usr/lib/libz.so.1 Reading symbols from /lib/ld-linux.so.2...done. Loaded symbols for /lib/ld-linux.so.2 Reading symbols from /lib/libnss_files.so.2...done. Loaded symbols for /lib/libnss_files.so.2 Reading symbols from /usr/lib/perl5/5.6.1/i386-linux/auto/Data/Dumper/Dumper.so...done. Loaded symbols for /usr/lib/perl5/5.6.1/i386-linux/auto/Data/Dumper/Dumper.so Reading symbols from /usr/lib/perl5/5.6.1/i386-linux/auto/Socket/Socket.so...done. Loaded symbols for /usr/lib/perl5/5.6.1/i386-linux/auto/Socket/Socket.so Reading symbols from /usr/lib/perl5/5.6.1/i386-linux/auto/IO/IO.so...done. Loaded symbols for /usr/lib/perl5/5.6.1/i386-linux/auto/IO/IO.so Reading symbols from /usr/lib/perl5/5.6.1/i386-linux/auto/Opcode/Opcode.so...done. Loaded symbols for /usr/lib/perl5/5.6.1/i386-linux/auto/Opcode/Opcode.so Reading symbols from /usr/lib/perl5/vendor_perl/5.6.1/i386-linux/auto/Digest/MD5/MD5.so...done. Loaded symbols for /usr/lib/perl5/vendor_perl/5.6.1/i386-linux/auto/Digest/MD5/MD5.so Reading symbols from /usr/lib/perl5/site_perl/5.6.0/i386-linux/auto/DBI/DBI.so...done. Loaded symbols for /usr/lib/perl5/site_perl/5.6.0/i386-linux/auto/DBI/DBI.so Reading symbols from /usr/lib/perl5/site_perl/5.6.0/i386-linux/auto/DBD/mysql/mysql.so...done. Loaded symbols for /usr/lib/perl5/site_perl/5.6.0/i386-linux/auto/DBD/mysql/mysql.so tReading symbols from /usr/lib/perl5/site_perl/5.6.1/i386-linux/auto/Apache/Request/Request.so...done. Loaded symbols for /usr/lib/perl5/site_perl/5.6.1/i386-linux/auto/Apache/Request/Request.so Reading symbols from /usr/lib/perl5/site_perl/5.6.1/i386-linux/auto/Apache/Cookie/Cookie.so...done. Loaded symbols for /usr/lib/perl5/site_perl/5.6.1/i386-linux/auto/Apache/Cookie/Cookie.so Reading symbols from /usr/lib/perl5/5.6.1/i386-linux/auto/B/B.so...done. Loaded symbols for /usr/lib/perl5/5.6.1/i386-linux/auto/B/B.so Reading symbols from /usr/lib/perl5/site_perl/5.6.1/i386-linux/auto/Apache/Symbol/Symbol.so...done. Loaded symbols for /usr/lib/perl5/site_perl/5.6.1/i386-linux/auto/Apache/Symbol/Symbol.so Reading symbols from /lib/libnss_nis.so.2...done. Loaded symbols for /lib/libnss_nis.so.2 Reading symbols from /lib/libnss_dns.so.2...done. Loaded symbols for /lib/libnss_dns.so.2 Reading symbols from /usr/apache-perl/libexec/mod_usertrack.so...done. Loaded symbols for /usr/apache-perl/libexec/mod_usertrack.so #0 0x0811cc59 in mod_perl_sent_header (r=0x8814724, val=0) at mod_perl.c:825 825 dPPDIR; (gdb) bt #0 0x0811cc59 in mod_perl_sent_header (r=0x8814724, val=0) at mod_perl.c:825 #1 0x0812a585 in XS_Apache_print (cv=0x846d678) at Apache.c:1738 #2 0x081a121c in Perl_pp_entersub () #3 0x0819b668 in Perl_runops_standard () #4 0x0815ad84 in S_call_body () #5 0x0815a951 in perl_call_sv () #6 0x0819c5b6 in Perl_pp_print () #7 0x0819b668 in Perl_runops_standard () #8 0x0815ad84 in S_call_body () #9 0x0815ab61 in perl_call_sv () #10 0x0811f466 in perl_call_handler (sv=0x8635d68, r=0x873d53c, args=0x0) at mod_perl.c:1655 #11 0x0811ebd3 in perl_run_stacked_handlers (hook=0x8211a19 "PerlHandler", r=0x873d53c, handlers=0x8635d44) at mod_perl.c:1371 #12 0x0811ce49 in perl_handler (r=0x873d53c) at mod_perl.c:897 #13 0x0813bdd1 in ap_invoke_handler (r=0x873d53c) at http_config.c:517 #14 0x0814cdac in process_request_internal (r=0x873d53c) at http_request.c:1308 #15 0x0814ce2e in ap_process_request (r=0x873d53c) at http_request.c:1324 #16 0x08145934 in child_main (child_num_arg=7) at http_main.c:4595 #17 0x08145b57 in make_child (s=0x8263c04, slot=7, now=1033666070) at http_main.c:4765 #18 0x08145e89 in perform_idle_server_maintenance () at http_main.c:4947 #19 0x081463b5 in standalone_main (argc=1, argv=0xbffffb14) at http_main.c:5184 #20 0x081469a8 in main (argc=1, argv=0xbffffb14) at http_main.c:5448 #21 0x400ea507 in init (argc=135554608, argv=0x1, envp=0xbffffb14) at ../sysdeps/unix/sysv/linux/init-first.c:68 (gdb) info locals r = (request_rec *) 0x8814724 val = 0 cld = (perl_dir_config *) 0x14 (gdb) print *r $1 = {pool = 0x6f697463, connection = 0x879006e, server = 0x7265702f, next = 0x2f6c, prev = 0x7473786d, main = 0x8006e73, the_request = 0x33333031
, assbackwards = 808859190, proxyreq = 825898550, header_only = 859256121, protocol = 0x3539312e
, proto_num = 825112887, hostname = 0x32373539
, request_time = 892940590, status_line = 0x312e3437
, status = 926364985, method = 0x3539312e
, method_number = 825110584, allowed = 909587769, sent_bodyct = 892940590, bytes_sent = 825112629, mtime = 808858937, chunked = 892940590, byterange = 825112885, boundary = 0x37353539
, range = 0x3539312e
, clength = 825112374, remaining = 909522233, read_length = 892940590, read_body = 825112630, read_chunked = 875836729, expecting_100 = 892940590, headers_in = 0x312e3335, headers_out = 0x35343539, err_headers_out = 0x3539312e, subprocess_env = 0x312e3135, notes = 0x34353539, content_type = 0x3539312e
, handler = 0x312e3634
, content_encoding = 0x38343539
, content_language = 0x3539312e
, content_languages = 0x312e3734, vlist_validator = 0x32333539
, no_cache = 892940590, no_local_copy = 825111859, unparsed_uri = 0x33333539
, uri = 0x3539312e
, filename = 0x312e3833
, path_info = 0x34333539
, args = 0x303a
, finfo = { st_dev = 3474023768978042929, __pad1 = 13878, st_ino = 859256121, st_mode = 892940590, st_nlink = 825112887, st_uid = 842478905, st_gid = 892940590, st_rdev = 3978707315559642167, __pad2 = 12590, st_size = 825110584, st_blksize = 909587769, st_blocks = 892940590, st_atime = 825112629, __unused1 = 808858937, st_mtime = 892940590, __unused2 = 825112885, st_ctime = 926233913, __unused3 = 892940590, __unused4 = 825112374, __unused5 = 909522233}, parsed_uri = { scheme = 0x3539312e
, hostinfo = 0x312e3836
, user = 0x34343539
, password = 0x3539312e
, hostname = 0x312e3335
, port_str = 0x35343539
, path = 0x3539312e
, query = 0x312e3135
, fragment = 0x34353539
, hostent = 0x3539312e, port = 13876, is_initialized = 0, dns_looked_up = 1, dns_resolved = 1}, per_dir_config = 0x38343539, request_config = 0x3539312e, htaccess = 0x312e3734, case_preserved_filename = 0x32333539
} (gdb) $2 = {pool = 0x6f697463, connection = 0x879006e, server = 0x7265702f, next = 0x2f6c, prev = 0x7473786d, main = 0x8006e73, the_request = 0x33333031
, assbackwards = 808859190, proxyreq = 825898550, header_only = 859256121, protocol = 0x3539312e
, proto_num = 825112887, hostname = 0x32373539
, request_time = 892940590, status_line = 0x312e3437
, status = 926364985, method = 0x3539312e
, method_number = 825110584, allowed = 909587769, sent_bodyct = 892940590, bytes_sent = 825112629, mtime = 808858937, chunked = 892940590, byterange = 825112885, boundary = 0x37353539
, range = 0x3539312e
, clength = 825112374, remaining = 909522233, read_length = 892940590, read_body = 825112630, read_chunked = 875836729, expecting_100 = 892940590, headers_in = 0x312e3335, headers_out = 0x35343539, err_headers_out = 0x3539312e, subprocess_env = 0x312e3135, notes = 0x34353539, content_type = 0x3539312e
, handler = 0x312e3634
, content_encoding = 0x38343539
, content_language = 0x3539312e
, content_languages = 0x312e3734, vlist_validator = 0x32333539
, no_cache = 892940590, no_local_copy = 825111859, unparsed_uri = 0x33333539
, uri = 0x3539312e
, filename = 0x312e3833
, path_info = 0x34333539
, args = 0x303a
, finfo = { st_dev = 3474023768978042929, __pad1 = 13878, st_ino = 859256121, st_mode = 892940590, st_nlink = 825112887, st_uid = 842478905, st_gid = 892940590, st_rdev = 3978707315559642167, __pad2 = 12590, st_size = 825110584, st_blksize = 909587769, st_blocks = 892940590, st_atime = 825112629, __unused1 = 808858937, st_mtime = 892940590, __unused2 = 825112885, st_ctime = 926233913, __unused3 = 892940590, __unused4 = 825112374, __unused5 = 909522233}, parsed_uri = { scheme = 0x3539312e
, hostinfo = 0x312e3836
, user = 0x34343539
, password = 0x3539312e
, hostname = 0x312e3335
, port_str = 0x35343539
, path = 0x3539312e
, query = 0x312e3135
, fragment = 0x34353539
, hostent = 0x3539312e, port = 13876, is_initialized = 0, dns_looked_up = 1, dns_resolved = 1}, per_dir_config = 0x38343539, request_config = 0x3539312e, htaccess = 0x312e3734, case_preserved_filename = 0x32333539
} (gdb) --------------040700020005000501060905 Content-Type: text/plain; name="gdb2.txt" Content-Transfer-Encoding: 8bit Content-Disposition: inline; filename="gdb2.txt" (gdb) bt #0 ap_palloc (a=0x87adbfc, reqsize=20) at alloc.c:740 #1 0x08138997 in ap_make_array (p=0x87adbfc, nelts=1, elt_size=4) at alloc.c:1022 #2 0x402f3cfb in ApacheCookie_new () from /usr/lib/perl5/site_perl/5.6.1/i386-linux/auto/Apache/Cookie/Cookie.so #3 0x402f2ac2 in XS_Apache__Cookie_parse () from /usr/lib/perl5/site_perl/5.6.1/i386-linux/auto/Apache/Cookie/Cookie.so #4 0x081a122c in Perl_pp_entersub () #5 0x0819b678 in Perl_runops_standard () #6 0x0815ad94 in perl_eval_sv () #7 0x0815ab71 in perl_call_sv () #8 0x0811f476 in perl_call_handler (sv=0x8635ff4, r=0x873baa4, args=0x0) at mod_perl.c:1658 #9 0x0811ebd3 in perl_run_stacked_handlers (hook=0x8211a19 "PerlHandler", r=0x873baa4, handlers=0x86342ac) at mod_perl.c:1371 #10 0x0811ce49 in perl_handler (r=0x873baa4) at mod_perl.c:897 #11 0x0813bdd1 in ap_invoke_handler (r=0x873baa4) at http_config.c:517 #12 0x0814cdbc in process_request_internal (r=0x873baa4) at http_request.c:1309 #13 0x0814ce3e in ap_process_request (r=0x873baa4) at http_request.c:1326 #14 0x08145934 in child_main (child_num_arg=6) at http_main.c:4595 #15 0x08145b57 in make_child (s=0x8263c04, slot=6, now=1033589630) at http_main.c:4765 #16 0x08145be6 in startup_children (number_to_start=10) at http_main.c:4792 #17 0x081461ab in standalone_main (argc=1, argv=0xbffffb14) at http_main.c:5100 #18 0x081469a8 in main (argc=1, argv=0xbffffb14) at http_main.c:5448 #19 0x400ea507 in init (argc=135554608, argv=0x1, envp=0xbffffb14) at ../sysdeps/unix/sysv/linux/init-first.c:68 (gdb) frame 0 #0 ap_palloc (a=0x87adbfc, reqsize=20) at alloc.c:740 740 char *first_avail = blok->h.first_avail; (gdb) info locals a = (struct pool *) 0x87adbfc reqsize = 20 size = 24 blok = (union block_hdr *) 0x0 first_avail = 0x0 new_first_avail = 0x2
(gdb) print *a $1 = {first = 0x87adc24, last = 0x0, cleanups = 0x0, subprocesses = 0x0, sub_pools = 0x0, sub_next = 0x0, sub_prev = 0x0, parent = 0x88807ac, free_first_avail = 0x87adc24 "��z\b,;y\b\234�r\b"} (gdb) print *blok Cannot access memory at address 0x0 (gdb) --------------040700020005000501060905 Content-Type: application/x-java-vm; name="GET" Content-Transfer-Encoding: base64 Content-Disposition: inline; filename="GET" R0VUIC9wZXJsL3NlY3Rpb24vZW50Y21wdC8gSFRUUC8xLjEKVXNlci1BZ2VudDogTW96aWxs YS81LjAgKGNvbXBhdGlibGU7IEtvbnF1ZXJvci8zOyBMaW51eCAyLjQuMTgtNSkKUHJhZ21h OiBuby1jYWNoZQpDYWNoZS1jb250cm9sOiBuby1jYWNoZQpBY2NlcHQ6IHRleHQvKiwgaW1h Z2UvanBlZywgaW1hZ2UvcG5nLCBpbWFnZS8qLCAqLyoKQWNjZXB0LUVuY29kaW5nOiB4LWd6 aXAsIGd6aXAsIGlkZW50aXR5CkFjY2VwdC1DaGFyc2V0OiBpc28tODg1OS0xLCB1dGYtODtx PTAuNSwgKjtxPTAuNQpBY2NlcHQtTGFuZ3VhZ2U6IGVuCkhvc3Q6IDE5Mi4xNjguMS4yMDo4 NApDb29raWU6IG14c3Rzbj0xMDMzNjY2MDY2OjE5NTczLjE5NTc5LjE5NTcyLjE5NTc0LjE5 NTc3LjE5NTgwLjE5NTc2LjE5NTU4LjE5NTYwLjE5NTU5LjE5NTU3LjE5NTY3LjE5NTY2LjE5 NTY4LjE5NTQ0LjE5NTUzLjE5NTQ1LjE5NTUxLjE5NTU0LjE5NTQ2LjE5NTQ4LjE5NTQ3LjE5 NTMyLjE5NTM1LjE5NTMzLjE5NTM4LjE5NTM0OjA7IEFwYWNoZT0xOTIuMTY4LjIuMS4xMjQ5 MjEwMzM2NjYwNjU3MTQKCgpHRVQgL3Blcmwvc2VjdGlvbi9lbnRjbXB0Lz8wMDAwMDAwMDAw MDAwMDAwMDAwMDAwMDAwMDAwMDAwMDAwMDAwMDAwMDAwMDAwMDAwMDAwMDAwMCBIVFRQLzEu MQpVc2VyLUFnZW50OiBNb3ppbGxhLzUuMCAoY29tcGF0aWJsZTsgS29ucXVlcm9yLzM7IExp bnV4IDIuNC4xOC01KQpQcmFnbWE6IG5vLWNhY2hlCkNhY2hlLWNvbnRyb2w6IG5vLWNhY2hl CkFjY2VwdDogdGV4dC8qLCBpbWFnZS9qcGVnLCBpbWFnZS9wbmcsIGltYWdlLyosICovKgpB Y2NlcHQtRW5jb2Rpbmc6IHgtZ3ppcCwgZ3ppcCwgaWRlbnRpdHkKQWNjZXB0LUNoYXJzZXQ6 IGlzby04ODU5LTEsIHV0Zi04O3E9MC41LCAqO3E9MC41CkFjY2VwdC1MYW5ndWFnZTogZW4K SG9zdDogMTkyLjE2OC4xLjIwOjg0CkNvb2tpZTogbXhzdHNuPTEwMzM2NjYwNjY6MTk1NzMu MTk1NzkuMTk1NzIuMTk1NzQuMTk1NzcuMTk1ODAuMTk1NzYuMTk1NTguMTk1NjAuMTk1NTku MTk1NTcuMTk1NjcuMTk1NjYuMTk1NjguMTk1NDQuMTk1NTMuMTk1NDUuMTk1NTEuMTk1NTQu MTk1NDYuMTk1NDguMTk1NDcuMTk1MzIuMTk1MzUuMTk1MzMuMTk1MzguMTk1MzQ6MDsgQXBh Y2hlPTE5Mi4xNjguMi4xLjEyNDkyMTAzMzY2NjA2NTcxNAo= --------------040700020005000501060905 Content-Type: text/plain; name="gdb-cookie-in-content_encoding.txt" Content-Transfer-Encoding: 8bit Content-Disposition: inline; filename="gdb-cookie-in-content_encoding.txt" #0 0x0811cc59 in mod_perl_sent_header (r=0x880ea54, val=0) at mod_perl.c:825 825 dPPDIR; (gdb) print *r $1 = {pool = 0x39312e37, connection = 0x2e373635, server = 0x36353931, next = 0x39312e36, prev = 0x2e383635, main = 0x36353931, the_request = 0x39312e35
, assbackwards = 775173173, proxyreq = 892680497, header_only = 959524403, protocol = 0x2e353435
, proto_num = 892680497, hostname = 0x39312e31
, request_time = 775173429, status_line = 0x34353931
, status = 959524406, method = 0x2e383435
, method_number = 875903281, allowed = 959524407, sent_bodyct = 775041845, bytes_sent = 859126065, mtime = 959524405, chunked = 775107381, byterange = 859126065, boundary = 0x39312e38
, range = 0x2e343335
, clength = 875903281, remaining = 959524400, read_length = 775041589, read_body = 842348849, read_chunked = 959524407, expecting_100 = 775172661, headers_in = 0x32353931, headers_out = 0x39312e30, err_headers_out = 0x3a333235, subprocess_env = 0x8800030, notes = 0x7473786d, content_type = 0x8006e73
, handler = 0x873d2fc "��s\b\204Py\b��r\b", content_encoding = 0x880eb44 "mxstsn", content_language = 0x880eb0c "��s\b\004", content_languages = 0x0, vlist_validator = 0x0, no_cache = 142666556, no_local_copy = 0, unparsed_uri = 0x880ef74 "/adsys/position/59/", uri = 0x873d2d4 "��s\b �\200\b\f�s\b", filename = 0x4
, path_info = 0x1
, args = 0x1
, finfo = {st_dev = 142666532, __pad1 = 60588, st_ino = 383809, st_mode = 1919250479, st_nlink = 1702047596, st_uid = 1869182051, st_gid = 110, st_rdev = 52142822223919, __pad2 = 30829, st_size = 28275, st_blksize = 858992689, st_blocks = 875704374, st_atime = 825897010, __unused1 = 943011129, st_mtime = 892940590, __unused2 = 825110582, st_ctime = 959788345, __unused3 = 892940590, __unused4 = 825112373, __unused5 = 926299449}, parsed_uri = { scheme = 0x3539312e
, hostinfo = 0x312e3636
, user = 0x38363539
, password = 0x3539312e
, hostname = 0x312e3536
, port_str = 0x34343539
, path = 0x3539312e
, query = 0x312e3335
, fragment = 0x35343539
, hostent = 0x3539312e, port = 12597, is_initialized = 0, dns_looked_up = 1, dns_resolved = 1}, per_dir_config = 0x34353539, request_config = 0x3539312e, htaccess = 0x312e3634, case_preserved_filename = 0x38343539
} (gdb) $2 = {pool = 0x39312e37, connection = 0x2e373635, server = 0x36353931, next = 0x39312e36, prev = 0x2e383635, main = 0x36353931, the_request = 0x39312e35
, assbackwards = 775173173, proxyreq = 892680497, header_only = 959524403, protocol = 0x2e353435
, proto_num = 892680497, hostname = 0x39312e31
, request_time = 775173429, status_line = 0x34353931
, status = 959524406, method = 0x2e383435
, method_number = 875903281, allowed = 959524407, sent_bodyct = 775041845, bytes_sent = 859126065, mtime = 959524405, chunked = 775107381, byterange = 859126065, boundary = 0x39312e38
, range = 0x2e343335
, clength = 875903281, remaining = 959524400, read_length = 775041589, read_body = 842348849, read_chunked = 959524407, expecting_100 = 775172661, headers_in = 0x32353931, headers_out = 0x39312e30, err_headers_out = 0x3a333235, subprocess_env = 0x8800030, notes = 0x7473786d, content_type = 0x8006e73
, handler = 0x873d2fc "��s\b\204Py\b��r\b", content_encoding = 0x880eb44 "mxstsn", content_language = 0x880eb0c "��s\b\004", content_languages = 0x0, vlist_validator = 0x0, no_cache = 142666556, no_local_copy = 0, unparsed_uri = 0x880ef74 "/adsys/position/59/", uri = 0x873d2d4 "��s\b �\200\b\f�s\b", filename = 0x4
, path_info = 0x1
, args = 0x1
, finfo = {st_dev = 142666532, __pad1 = 60588, st_ino = 383809, st_mode = 1919250479, st_nlink = 1702047596, st_uid = 1869182051, st_gid = 110, st_rdev = 52142822223919, __pad2 = 30829, st_size = 28275, st_blksize = 858992689, st_blocks = 875704374, st_atime = 825897010, __unused1 = 943011129, st_mtime = 892940590, __unused2 = 825110582, st_ctime = 959788345, __unused3 = 892940590, __unused4 = 825112373, __unused5 = 926299449}, parsed_uri = { scheme = 0x3539312e
, hostinfo = 0x312e3636
, user = 0x38363539
, password = 0x3539312e
, hostname = 0x312e3536
, port_str = 0x34343539
, path = 0x3539312e
, query = 0x312e3335
, fragment = 0x35343539
, hostent = 0x3539312e, port = 12597, is_initialized = 0, dns_looked_up = 1, dns_resolved = 1}, per_dir_config = 0x34353539, request_config = 0x3539312e, htaccess = 0x312e3634, case_preserved_filename = 0x38343539
} (gdb) --------------040700020005000501060905--