Return-Path: X-Original-To: apmail-couchdb-user-archive@www.apache.org Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1C9EF18EBE for ; Fri, 8 Jan 2016 18:41:12 +0000 (UTC) Received: (qmail 57526 invoked by uid 500); 8 Jan 2016 18:41:11 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 57455 invoked by uid 500); 8 Jan 2016 18:41:11 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 57442 invoked by uid 99); 8 Jan 2016 18:41:10 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 08 Jan 2016 18:41:10 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 5C2101A01DD for ; Fri, 8 Jan 2016 18:41:10 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.898 X-Spam-Level: ** X-Spam-Status: No, score=2.898 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id nR45cReqZNBy for ; Fri, 8 Jan 2016 18:41:05 +0000 (UTC) Received: from mail-io0-f177.google.com (mail-io0-f177.google.com [209.85.223.177]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id 6BE4643A2B for ; Fri, 8 Jan 2016 18:41:05 +0000 (UTC) Received: by mail-io0-f177.google.com with SMTP id q21so294774425iod.0 for ; Fri, 08 Jan 2016 10:41:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=6IZGk61YOiLzjh+PAMxmZ+diELguRZby8ATpduXGW2A=; b=l+0JgPgVRn06XKDEBjOhxjcF95tNEGbv5OAB4rJ4fu7MuPd5bKxNPndhYvva6eTyT1 dMekbP7INnWZnCFd6Pk7HbnlsNmD2mBfIbzmJ8BpU69tOokxtWEqvGQ8rW5pZqFImjef VFJ9RK6wy8k//WlMxLDAFU2HAS/gNOew2HeaFk2BCmpXZVclKvmw6OKiLBySAot0YE3h rIb6bVT5rp8vK2HEBNvLNyM6morWqOBbq1XC3pKlKaxdvla/6LYCicdO4juM+igtZzlA bvEfbpYB1h3pPs3xqKpaVaK0AWOOwrZ4fYekSvW42hcQAABszcxjxNFx1tB9+YrOBPgJ f2Jg== MIME-Version: 1.0 X-Received: by 10.107.170.212 with SMTP id g81mr87761820ioj.44.1452278465080; Fri, 08 Jan 2016 10:41:05 -0800 (PST) Received: by 10.36.52.137 with HTTP; Fri, 8 Jan 2016 10:41:05 -0800 (PST) In-Reply-To: References: Date: Fri, 8 Jan 2016 18:41:05 +0000 Message-ID: Subject: Re: couchdb crashes From: Miles Waller To: user@couchdb.apache.org Content-Type: multipart/alternative; boundary=001a11425b7006b08e0528d6ee42 --001a11425b7006b08e0528d6ee42 Content-Type: text/plain; charset=UTF-8 > Hi, > > I'm experiencing some intermittent hangs from couchdb where the process > remains up but is unresponsive. Does anyone else have a similar > environment or issues? > > I am running couchdb 1.6.1 (on windows, installed from binary) behind a > load balancer (haproxy). The load balancer conducts a health check on the > couch ports at the TCP level - so connecting then disconnecting, rather > than issuing a full http request. > > I experience intermittent hangs - every few days in frequency. The load > balancer itself is checking health far more frequently, so this is > puzzling. I only implicate the load balancer because (a) it was the only > major change before this behaviour started (though some time before) and > (b) the tcp_close in the error log - so not exactly conclusive. > > What can I do to isolate what's going on here or get some more conclusive > logging? > > Thanks for any help/direction anyone can provide! > > miles > > > [Tue, 29 Dec 2015 11:42:20 GMT] [error] [<0.7108.354>] > {error_report,<0.34.0>, > > {<0.7108.354>,crash_report, > > [[{initial_call, > > {mochiweb_acceptor,init, > > ['Argument__1','Argument__2','Argument__3']}}, > > {pid,<0.7108.354>}, > > {registered_name,[]}, > > {error_info, > > {error, > > {badmatch,{error,einval}}, > > [{mochiweb_http,new_request,3, > > [{file, > > > "c:/cygwin/relax/APACHE~2.1/src/mochiweb/mochiweb_http.erl"}, > > {line,133}]}, > > {mochiweb_http,handle_invalid_request,3, > > [{file, > > > "c:/cygwin/relax/APACHE~2.1/src/mochiweb/mochiweb_http.erl"}, > > {line,127}]}, > > {mochiweb_http,handle_invalid_request,1, > > [{file, > > > "c:/cygwin/relax/APACHE~2.1/src/mochiweb/mochiweb_http.erl"}, > > {line,122}]}, > > {proc_lib,init_p_do_apply,3, > > [{file,"proc_lib.erl"},{line,239}]}]}}, > > {ancestors, > > [couch_httpd,couch_secondary_services, > > couch_server_sup,<0.35.0>]}, > > {messages,[{tcp_closed,#Port<0.8957559>}]}, > > {links,[<0.110.0>]}, > > {dictionary,[{couch_rewrite_count,0}]}, > > {trap_exit,false}, > > {status,running}, > > {heap_size,1598}, > > {stack_size,27}, > > {reductions,453873996}], > > []]}} > > [Tue, 29 Dec 2015 11:42:20 GMT] [error] [<0.32335.308>] > {error_report,<0.34.0>, > > {<0.32335.308>,crash_report, > > [[{initial_call, > > {mochiweb_acceptor,init, > > > ['Argument__1','Argument__2','Argument__3']}}, > > {pid,<0.32335.308>}, > > {registered_name,[]}, > > {error_info, > > {error, > > {badmatch,{error,einval}}, > > [{mochiweb_http,new_request,3, > > [{file, > > > "c:/cygwin/relax/APACHE~2.1/src/mochiweb/mochiweb_http.erl"}, > > {line,133}]}, > > {mochiweb_http,handle_invalid_request,3, > > [{file, > > > "c:/cygwin/relax/APACHE~2.1/src/mochiweb/mochiweb_http.erl"}, > > {line,127}]}, > > {mochiweb_http,handle_invalid_request,1, > > [{file, > > > "c:/cygwin/relax/APACHE~2.1/src/mochiweb/mochiweb_http.erl"}, > > {line,122}]}, > > {proc_lib,init_p_do_apply,3, > > [{file,"proc_lib.erl"},{line,239}]}]}}, > > {ancestors, > > [couch_httpd,couch_secondary_services, > > couch_server_sup,<0.35.0>]}, > > {messages,[{tcp_closed,#Port<0.7726814>}]}, > > {links,[<0.110.0>]}, > > {dictionary,[{couch_rewrite_count,0}]}, > > {trap_exit,false}, > > {status,running}, > > {heap_size,1598}, > > {stack_size,27}, > > {reductions,604125398}], > > []]}} > > [Tue, 29 Dec 2015 11:42:23 GMT] [error] [<0.1123.498>] > {error_report,<0.34.0>, > > {<0.1123.498>,crash_report, > > [[{initial_call, > > {mochiweb_acceptor,init, > > ['Argument__1','Argument__2','Argument__3']}}, > > {pid,<0.1123.498>}, > > {registered_name,[]}, > > {error_info, > > {error, > > {badmatch,{error,einval}}, > > [{mochiweb_http,new_request,3, > > [{file, > > > "c:/cygwin/relax/APACHE~2.1/src/mochiweb/mochiweb_http.erl"}, > > {line,133}]}, > > {mochiweb_http,handle_invalid_request,3, > > [{file, > > > "c:/cygwin/relax/APACHE~2.1/src/mochiweb/mochiweb_http.erl"}, > > {line,127}]}, > > {mochiweb_http,handle_invalid_request,1, > > [{file, > > > "c:/cygwin/relax/APACHE~2.1/src/mochiweb/mochiweb_http.erl"}, > > {line,122}]}, > > {proc_lib,init_p_do_apply,3, > > [{file,"proc_lib.erl"},{line,239}]}]}}, > > {ancestors, > > [couch_httpd,couch_secondary_services, > > couch_server_sup,<0.35.0>]}, > > {messages,[{tcp_closed,#Port<0.12863051>}]}, > > {links,[<0.110.0>]}, > > {dictionary,[{couch_rewrite_count,0}]}, > > {trap_exit,false}, > > {status,running}, > > {heap_size,1598}, > > {stack_size,27}, > > {reductions,9957}], > > []]}} > > [Wed, 30 Dec 2015 03:28:28 GMT] [error] [<0.2619.498>] > {error_report,<0.34.0>, > > {<0.2619.498>,crash_report, > > [[{initial_call, > > {mochiweb_acceptor,init, > > ['Argument__1','Argument__2','Argument__3']}}, > > {pid,<0.2619.498>}, > > {registered_name,[]}, > > {error_info, > > {error, > > {badmatch,{error,einval}}, > > [{mochiweb_http,new_request,3, > > [{file, > > > "c:/cygwin/relax/APACHE~2.1/src/mochiweb/mochiweb_http.erl"}, > > {line,133}]}, > > {mochiweb_http,handle_invalid_request,3, > > [{file, > > > "c:/cygwin/relax/APACHE~2.1/src/mochiweb/mochiweb_http.erl"}, > > {line,127}]}, > > {mochiweb_http,handle_invalid_request,1, > > [{file, > > > "c:/cygwin/relax/APACHE~2.1/src/mochiweb/mochiweb_http.erl"}, > > {line,122}]}, > > {proc_lib,init_p_do_apply,3, > > [{file,"proc_lib.erl"},{line,239}]}]}}, > > {ancestors, > > [couch_httpd,couch_secondary_services, > > couch_server_sup,<0.35.0>]}, > > {messages,[{tcp_closed,#Port<0.12863082>}]}, > > {links,[<0.110.0>]}, > > {dictionary,[{couch_rewrite_count,0}]}, > > {trap_exit,false}, > > {status,running}, > > {heap_size,1598}, > > {stack_size,27}, > > {reductions,505401737}], > > []]}} > > [Wed, 30 Dec 2015 03:28:28 GMT] [error] [<0.21043.500>] > {error_report,<0.34.0>, > > {<0.21043.500>,crash_report, > > [[{initial_call, > > {mochiweb_acceptor,init, > > > ['Argument__1','Argument__2','Argument__3']}}, > > {pid,<0.21043.500>}, > > {registered_name,[]}, > > {error_info, > > {error, > > {badmatch,{error,einval}}, > > [{mochiweb_http,new_request,3, > > [{file, > > > "c:/cygwin/relax/APACHE~2.1/src/mochiweb/mochiweb_http.erl"}, > > {line,133}]}, > > {mochiweb_http,handle_invalid_request,3, > > [{file, > > > "c:/cygwin/relax/APACHE~2.1/src/mochiweb/mochiweb_http.erl"}, > > {line,127}]}, > > {mochiweb_http,handle_invalid_request,1, > > [{file, > > > "c:/cygwin/relax/APACHE~2.1/src/mochiweb/mochiweb_http.erl"}, > > {line,122}]}, > > {proc_lib,init_p_do_apply,3, > > [{file,"proc_lib.erl"},{line,239}]}]}}, > > {ancestors, > > [couch_httpd,couch_secondary_services, > > couch_server_sup,<0.35.0>]}, > > {messages,[{tcp_closed,#Port<0.12900407>}]}, > > {links,[<0.110.0>]}, > > {dictionary,[{couch_rewrite_count,0}]}, > > {trap_exit,false}, > > {status,running}, > > {heap_size,1598}, > > {stack_size,27}, > > {reductions,508830824}], > > []]}} > > [Tue, 05 Jan 2016 22:11:55 GMT] [error] [<0.112.675>] > {error_report,<0.34.0>, > > {<0.112.675>,crash_report, > > [[{initial_call, > > {mochiweb_acceptor,init, > > ['Argument__1','Argument__2','Argument__3']}}, > > {pid,<0.112.675>}, > > {registered_name,[]}, > > {error_info, > > {error, > > {badmatch,{error,einval}}, > > [{mochiweb_http,new_request,3, > > [{file, > > > "c:/cygwin/relax/APACHE~2.1/src/mochiweb/mochiweb_http.erl"}, > > {line,133}]}, > > {mochiweb_http,handle_invalid_request,3, > > [{file, > > > "c:/cygwin/relax/APACHE~2.1/src/mochiweb/mochiweb_http.erl"}, > > {line,127}]}, > > {mochiweb_http,handle_invalid_request,1, > > [{file, > > > "c:/cygwin/relax/APACHE~2.1/src/mochiweb/mochiweb_http.erl"}, > > {line,122}]}, > > {proc_lib,init_p_do_apply,3, > > [{file,"proc_lib.erl"},{line,239}]}]}}, > > {ancestors, > > [couch_httpd,couch_secondary_services, > > couch_server_sup,<0.35.0>]}, > > {messages,[{tcp_closed,#Port<0.17533102>}]}, > > {links,[<0.110.0>]}, > > {dictionary,[{couch_rewrite_count,0}]}, > > {trap_exit,false}, > > {status,running}, > > {heap_size,1598}, > > {stack_size,27}, > > {reductions,6370382}], > > []]}} > > > --001a11425b7006b08e0528d6ee42--