From user-return-21096-apmail-couchdb-user-archive=couchdb.apache.org@couchdb.apache.org  Tue Jun  5 20:06:12 2012
Return-Path: <user-return-21096-apmail-couchdb-user-archive=couchdb.apache.org@couchdb.apache.org>
X-Original-To: apmail-couchdb-user-archive@www.apache.org
Delivered-To: apmail-couchdb-user-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 52AD3928F
	for <apmail-couchdb-user-archive@www.apache.org>; Tue,  5 Jun 2012 20:06:12 +0000 (UTC)
Received: (qmail 46828 invoked by uid 500); 5 Jun 2012 20:06:10 -0000
Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org
Received: (qmail 46735 invoked by uid 500); 5 Jun 2012 20:06:10 -0000
Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@couchdb.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@couchdb.apache.org>
List-Post: <mailto:user@couchdb.apache.org>
List-Id: <user.couchdb.apache.org>
Reply-To: user@couchdb.apache.org
Delivered-To: mailing list user@couchdb.apache.org
Received: (qmail 46724 invoked by uid 99); 5 Jun 2012 20:06:10 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 05 Jun 2012 20:06:10 +0000
X-ASF-Spam-Status: No, hits=-0.7 required=5.0
	tests=RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of paul.joseph.davis@gmail.com designates 209.85.212.52 as permitted sender)
Received: from [209.85.212.52] (HELO mail-vb0-f52.google.com) (209.85.212.52)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 05 Jun 2012 20:06:05 +0000
Received: by vbzb23 with SMTP id b23so4100831vbz.11
        for <user@couchdb.apache.org>; Tue, 05 Jun 2012 13:05:44 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:in-reply-to:references:from:date:message-id:subject:to
         :content-type:content-transfer-encoding;
        bh=Esq801T5E4g/II5LvQdL8wx8uz9JQ7hxy6yi2ppAgOY=;
        b=A+7NLkJT66fNVX38h/+Fwmh851ePJuT9l8w+08LYn/2y5pSm8oTWNcYYWiSm2H52M1
         7cWR9vknXhNr4PrJqE7ZWTq8jxJJMYaVmoml3C8qr2bHJPrzH0XrOOFsehfkHtVbuNdQ
         6t6OVBkmdM8pkN4PW88eLQTP4D2yRWkrAAeStfqSlMoIy5BVgjKlTPBwkoXYFkba/BBI
         oAxUHWjDOLSHwgyFMbziY90TBrZq9X67aCdVE6bvyn0FsTkI2dC5H49ig5hcOOwcQv2A
         w3Ux2TPemkIr03RJPWE/+lJNNZ9bVaxBeSNI21L8nCSwFDBaSIxW2o40KRUAAOvMqJSq
         nObQ==
Received: by 10.52.30.110 with SMTP id r14mr16064857vdh.0.1338926744648; Tue,
 05 Jun 2012 13:05:44 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.220.87.144 with HTTP; Tue, 5 Jun 2012 13:05:04 -0700 (PDT)
In-Reply-To: <D59B2A56-78CA-4BF0-85F4-B3E6BD5260EB@poplatek.fi>
References: <1FFE2F48-43B2-4493-AC3B-1D5CCBD057BA@poplatek.fi>
 <CAHZBNKa0Tm4+wwDjUCCH3X+Ankx3tKEix4pp1BFFTg0xDudaXw@mail.gmail.com> <D59B2A56-78CA-4BF0-85F4-B3E6BD5260EB@poplatek.fi>
From: Paul Davis <paul.joseph.davis@gmail.com>
Date: Tue, 5 Jun 2012 15:05:04 -0500
Message-ID: <CAJ_m3YDV-4VVQN_7VNOd4rK+W6-OazehvSeQcpwzRYmLVh2haw@mail.gmail.com>
Subject: Re: CouchDB 1.2.0 indexing dies silently
To: user@couchdb.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
X-Virus-Checked: Checked by ClamAV on apache.org

Did you cut and paste this log transcript with multiple pastes?
There's a really weird view repetition but I'm going to just assume
that you accidentally overlapped a copy/paste into email for now.

On Tue, Jun 5, 2012 at 5:07 AM, Sami Sierla <sami.sierla@poplatek.fi> wrote=
:
> Dave,
>
> Thank You for quick reply. The issues appear in a production environment =
to which I don't have access to modify configuration or design documents. L=
og level at the moment is "error"
>
> Below is a lengthy log dump we got when the os_process_timeout was 5000, =
after increasing timeout to 30000 there has been no log entries at all when=
 indexing stops.
>
> -----
>
> [Thu, 31 May 2012 17:42:17 GMT] [error] [<0.15656.0>] OS Process Error <0=
.15657.0> :: {os_process_error, "OS process timed out."}
> [Thu, 31 May 2012 17:42:17 GMT] [error] [emulator] Error in process <0.15=
656.0> with exit value: {{nocatch,{os_process_error,"OS process timed out."=
}},[{couch_os_process,prompt,2},{couch_query_servers,map_doc_raw,2},{couch_=
view_updater,'-do_maps/3-fun-0-',3},{couch_view_updater,do_maps,3}]}
> [Thu, 31 May 2012 17:42:17 GMT] [error] [<0.15648.0>] ** Generic server <=
0.15648.0> terminating
> ** Last message in was {'EXIT',<0.15653.0>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {{nocatch,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{os_proces=
s_error,"OS process timed out."}},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0[{couch_os_process=
,prompt,2},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {couch_query_serv=
ers,map_doc_raw,2},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {couch_view_updat=
er,'-do_maps/3-fun-0-',3},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {couch_view_updat=
er,do_maps,3}]}}
> ** When Server state =3D=3D {group_state,undefined,<<"mutka_replicated">>=
,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {"/data/mutka/couchdb-ind=
ex",<<"mutka_replicated">>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{group,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 <<223,185,95,248,235,=
18,77,64,18,164,253,96,95,237,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 204,20>>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 nil,<<"_design/transa=
ctionA-1.2.0">>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 <<"javascript">>,[],
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 [{view,0,0,0,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 [<<"transactionBy=
PaymentInstrument">>],
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 <<"function(doc) =
{ if (doc.objectType =3D=3D \"ProtocolTransaction\" && doc.paymentInstrumen=
tId) { emit([doc.paymentInstrumentId,doc.startTimestamp], null); } }">>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 nil,[],[]},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{view,1,0,0,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 [<<"transactionBy=
Terminal">>],
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 <<"function(doc) =
{ if (doc.objectType =3D=3D \"ProtocolTransaction\" && doc.paymentTerminalI=
d) { emit([doc.paymentTerminalId,doc.startTimestamp], null); } }">>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 nil,[],[]},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{view,2,0,0,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 [<<"transactionBy=
Session">>],
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 <<"function(doc) =
{ if (doc.objectType =3D=3D \"ProtocolTransaction\" && doc.protocolSessionI=
d) { emit(doc.protocolSessionId,doc.protocolTransactionId); } }">>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 nil,[],[]},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{view,3,0,0,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 [<<"transactionBy=
RayId">>],
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 <<"function(doc) =
{ if (doc.objectType =3D=3D \"ProtocolTransaction\" && doc.cId) { emit([-(-=
doc.cId),doc.startTimestamp], null); } }">>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 nil,[],[]}],
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {[]},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 nil,0,0,nil,nil}},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {group,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0<<223,185,95,248,235,1=
8,77,64,18,164,253,96,95,237,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0204,20>>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0<0.15650.0>,<<"_design=
/transactionA-1.2.0">>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0<<"javascript">>,[],
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0[{view,0,236439939,0,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0[<<"transactionByP=
aymentInstrument">>],
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0<<"function(doc) {=
 if (doc.objectType =3D=3D \"ProtocolTransaction\" && doc.paymentInstrument=
Id) { emit([doc.paymentInstrumentId,doc.startTimestamp], null); } }">>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{btree,<0.15650.0>=
,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {47573274456,{869=
4059,[]},257926106},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_btree.=
3.71804109>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_btree.=
4.115144917>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_view.l=
ess_json_ids.2>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_view_g=
roup.10.26766604>,snappy},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0[],[]},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {view,1,236439939,0,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0[<<"transactionByT=
erminal">>],
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0<<"function(doc) {=
 if (doc.objectType =3D=3D \"ProtocolTransaction\" && doc.paymentTerminalId=
) { emit([doc.paymentTerminalId,doc.startTimestamp], null); } }">>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{btree,<0.15650.0>=
,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {47574093427,{336=
38477,[]},942288018},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_btree.=
3.71804109>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_btree.=
4.115144917>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_view.l=
ess_json_ids.2>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_view_g=
roup.10.26766604>,snappy},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0[],[]},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {view,2,236439939,0,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0[<<"transactionByS=
ession">>],
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0<<"function(doc) {=
 if (doc.objectType =3D=3D \"ProtocolTransaction\" && doc.protocolSessionId=
) { emit(doc.protocolSessionId,doc.protocolTransactionId); } }">>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{btree,<0.15650.0>=
,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {47574114746,{924=
1366,[]},131141244},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_btree.=
3.71804109>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_btree.=
4.115144917>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_view.l=
ess_json_ids.2>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_view_g=
roup.10.26766604>,snappy},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0[],[]},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {view,1,236439939,0,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0[<<"transactionByT=
erminal">>],
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0<<"function(doc) {=
 if (doc.objectType =3D=3D \"ProtocolTransaction\" && doc.paymentTerminalId=
) { emit([doc.paymentTerminalId,doc.startTimestamp], null); } }">>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{btree,<0.15650.0>=
,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {47574093427,{336=
38477,[]},942288018},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_btree.=
3.71804109>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_btree.=
4.115144917>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_view.l=
ess_json_ids.2>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_view_g=
roup.10.26766604>,snappy},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0[],[]},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {view,2,236439939,0,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0[<<"transactionByS=
ession">>],
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0<<"function(doc) {=
 if (doc.objectType =3D=3D \"ProtocolTransaction\" && doc.protocolSessionId=
) { emit(doc.protocolSessionId,doc.protocolTransactionId); } }">>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{btree,<0.15650.0>=
,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {47574114746,{924=
1366,[]},131141244},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_btree.=
3.71804109>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_btree.=
4.115144917>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_view.l=
ess_json_ids.2>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_view_g=
roup.10.26766604>,snappy},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0[],[]},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {view,3,236433956,0,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0[<<"transactionByR=
ayId">>],
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0<<"function(doc) {=
 if (doc.objectType =3D=3D \"ProtocolTransaction\" && doc.cId) { emit([-(-d=
oc.cId),doc.startTimestamp], null); } }">>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{btree,<0.15650.0>=
,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {47559121340,{225=
0018,[]},76590679},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_btree.=
3.71804109>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_btree.=
4.115144917>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_view.l=
ess_json_ids.2>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_view_g=
roup.10.26766604>,snappy},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0[],[]}],
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{[]},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{btree,<0.15650.0>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {47572622835,[],10610=
98089},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_btree.3.71=
804109>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_btree.4.11=
5144917>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 #Fun<couch_btree.5.93=
788370>,nil,snappy},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0236439939,0,nil,nil},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 <0.15653.0>,nil,false,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 [{{<0.15441.0>,#Ref<0.0.0=
.182446>},409571621}],
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 <0.15652.0>,false}
> ** Reason for termination =3D=3D
> ** {os_process_error,"OS process timed out."}
> [Thu, 31 May 2012 17:42:17 GMT] [error] [<0.15648.0>] {error_report,<0.31=
.0>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {<0.15648.0>,crash_report,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0[[{initial_call,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {couch_view_group,ini=
t,['Argument__1']}},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{pid,<0.15648.0>},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{registered_name,[]},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{error_info,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {exit,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{os_process_error,=
"OS process timed out."},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0[{gen_server,termi=
nate,6},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {proc_lib,init_p_=
do_apply,3}]}},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{ancestors,[<0.15647.0=
>]},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{messages,[]},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{links,[<0.15650.0>,<0=
.123.0>]},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{dictionary,[]},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{trap_exit,true},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{status,running},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{heap_size,2584},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{stack_size,24},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{reductions,18059924}]=
,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 []]}}
> [Thu, 31 May 2012 17:42:17 GMT] [error] [<0.15441.0>] Uncaught server err=
or: {os_process_error, <<"OS process timed out.">>}
> [Thu, 31 May 2012 17:42:17 GMT] [error] [<0.15650.0>] ** Generic server <=
0.15650.0> terminating
> ** Last message in was {'EXIT',<0.15648.0>, {os_process_error,"OS process=
 timed out."}}
> ** When Server state =3D=3D {file,{file_descriptor,prim_file,{#Port<0.211=
9>,19}}, 47574426987}
> ** Reason for termination =3D=3D
> ** {os_process_error,"OS process timed out."}
> [Thu, 31 May 2012 17:42:17 GMT] [error] [<0.15650.0>] {error_report,<0.31=
.0>,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {<0.15650.0>,crash_report,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0[[{initial_call,{couch_fil=
e,init,['Argument__1']}},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{pid,<0.15650.0>},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{registered_name,[]},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{error_info,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {exit,
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{os_process_error,=
"OS process timed out."},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0[{gen_server,termi=
nate,6},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 {proc_lib,init_p_=
do_apply,3}]}},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{ancestors,[<0.15648.0=
>,<0.15647.0>]},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{messages,[{'EXIT',<0.=
15652.0>,shutdown}]},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{links,[]},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{dictionary,[]},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{trap_exit,true},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{status,running},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{heap_size,2584},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{stack_size,24},
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0{reductions,2773239523=
6}],
> =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 []]}}
>
>
> -Sami
> On Jun 5, 2012, at 12:23 PM, Dave Cottlehuber wrote:
>
>> On 5 June 2012 11:13, Sami Sierla <sami.sierla@poplatek.fi> wrote:
>>> Hi,
>>>
>>> We have a rather large database (about 90 million documents /200GB) run=
ning on CouchDB (1.0.3) and we're now updating it to version 1.2.0 due to v=
iew compaction problems (large view group compactions never finished).
>>>
>>> At the moment we are rebuilding (JavaScript) views with 1.2.0 but durin=
g this we have stumbled upon to new problem : indexer processes suddenly ju=
st disappear. Initially we got "OS Process Timeout" -errors to log but afte=
r adjusting os_process_timeout to 30secs indexing still prematurely stops b=
ut without any log entry.
>>>
>>> Any ideas what might cause this behavior?
>>>
>>> CouchDB is running on RHEL 5.8 and is statically linked with SpiderMonk=
ey 1.8.5
>>>
>>>
>>> Regards,
>>> Sami Sierla / Poplatek Oy / Finland
>>
>> Sami,
>>
>> Have you anything useful in the couch.log file? Are you able to run
>> the view generation in debug mode (might not be possible due to disk
>> space constraints =A0& performance impact).
>>
>> Also, if you query the view with ?limit=3D1&descending=3Dtrue you'll get
>> the last doc that couch successfully processed (I think). Is there
>> anything special about that or the subsequent documents? If you
>> process the view & those docs manually into node or js.exe directly
>> [1] does that work?
>>
>> There's quite a few changes in 1.0.3 -> 1.2.0 including better
>> detection of ill-formed docs amongst others, more info will help
>> narrow this down.
>>
>> A+
>> Dave
>>
>> [1]: http://wiki.apache.org/couchdb/Troubleshooting#Map.2BAC8-Reduce_deb=
ugging
>