Return-Path: Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: (qmail 58883 invoked from network); 6 Oct 2009 20:33:30 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 6 Oct 2009 20:33:30 -0000 Received: (qmail 73010 invoked by uid 500); 6 Oct 2009 20:33:29 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 72954 invoked by uid 500); 6 Oct 2009 20:33:29 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 72944 invoked by uid 99); 6 Oct 2009 20:33:29 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 06 Oct 2009 20:33:29 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of glenn@rempe.us designates 209.85.210.203 as permitted sender) Received: from [209.85.210.203] (HELO mail-yx0-f203.google.com) (209.85.210.203) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 06 Oct 2009 20:33:17 +0000 Received: by mail-yx0-f203.google.com with SMTP id 41so9824477yxe.30 for ; Tue, 06 Oct 2009 13:32:57 -0700 (PDT) MIME-Version: 1.0 Received: by 10.91.189.1 with SMTP id r1mr886195agp.109.1254861177467; Tue, 06 Oct 2009 13:32:57 -0700 (PDT) In-Reply-To: References: <6cfccb3d0910030910m678c9157o811a57e02ffbeff0@mail.gmail.com> <6cfccb3d0910031824q5d9362c2k7719b32a779e956f@mail.gmail.com> <1521F562-7878-423B-BEC3-FF2A1916DA0C@gmail.com> <6cfccb3d0910032307i1df64f79u437d5c803bff2c50@mail.gmail.com> <6cfccb3d0910052346hb4ca0b3o7eb6e77fec4ac1a7@mail.gmail.com> <99817787-2B70-4346-A4BA-21C7C258AC65@apache.org> <6cfccb3d0910061242s33be1bb5j9dbffb8dd7091c25@mail.gmail.com> From: Glenn Rempe Date: Tue, 6 Oct 2009 13:32:37 -0700 Message-ID: <6cfccb3d0910061332k57e5de33tfaeff04e2f0cd637@mail.gmail.com> Subject: Re: Timeout Error when trying to access views + Indexing problems To: user@couchdb.apache.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org Hi Seggy, Yes, I already have the 50+ GB data file on an 500GB EBS volume. And trust me, I have a snapshot. :-) I just want to avoid spinning up lots of X-Large instances unless we have something that would really benefity from trying concurrently. Gets pricey. :-) Cheers, G On Tue, Oct 6, 2009 at 1:26 PM, Seggy Umboh wrote: > Glenn, > Since you are running on EC2, may I also suggest you put the couchdb data > directory on a EBS volume and snapshot it if you have not already, that w= ay > you can spin up EC2 instances to try each of the suggestions being given = on > the list on separate copies of the data > > Good luck! > > > On Tue, Oct 6, 2009 at 1:13 PM, Paul Davis w= rote: > >> On Tue, Oct 6, 2009 at 3:42 PM, Glenn Rempe wrote: >> > Is there some way we can instrument and log how much memory the VM >> > thinks it has somewhere in the critical path piece of erlang code? =C2= =A0Or >> > is there another way I can track that externally? >> > >> > G >> > >> > On Tue, Oct 6, 2009 at 12:13 PM, Adam Kocoloski >> wrote: >> >> On Oct 6, 2009, at 2:46 AM, Glenn Rempe wrote: >> >> >> >> TMI logging doesn't really exist, no one uses that level internally. = =C2=A0I >> >> agree with Paul here, the lack of error messages indicates an instant= VM >> >> death. =C2=A0The most common way to cause that is by running out of m= emory, >> but >> >> view indexing is not supposed to use a large amount of memory at all. >> >> >> >> Adam >> > >> >> Here's a quick and dirty script that should work ish I think probably. >> I only tested it minimally. As it, no syntax errors and it prints the >> first vm size as expected. >> >> Just run that in a terminal while the indexer runs. It should die at >> the same time the the Erlang process dies. >> > --=20 Glenn Rempe email : glenn@rempe.us voice : (415) 894-5366 or (415)-89G-LENN twitter : @grempe contact info : http://www.rempe.us/contact.html pgp : http://www.rempe.us/gnupg.txt