Return-Path: X-Original-To: apmail-couchdb-user-archive@www.apache.org Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 61B6F96E2 for ; Wed, 1 Feb 2012 21:59:42 +0000 (UTC) Received: (qmail 59787 invoked by uid 500); 1 Feb 2012 21:59:40 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 59745 invoked by uid 500); 1 Feb 2012 21:59:39 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 59737 invoked by uid 99); 1 Feb 2012 21:59:39 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Feb 2012 21:59:39 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of dave@muse.net.nz designates 209.85.212.52 as permitted sender) Received: from [209.85.212.52] (HELO mail-vw0-f52.google.com) (209.85.212.52) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Feb 2012 21:59:33 +0000 Received: by vbih1 with SMTP id h1so1785273vbi.11 for ; Wed, 01 Feb 2012 13:59:12 -0800 (PST) MIME-Version: 1.0 Received: by 10.52.71.226 with SMTP id y2mr97101vdu.78.1328133552233; Wed, 01 Feb 2012 13:59:12 -0800 (PST) Received: by 10.52.34.241 with HTTP; Wed, 1 Feb 2012 13:59:12 -0800 (PST) X-Originating-IP: [84.172.64.190] In-Reply-To: References: Date: Wed, 1 Feb 2012 22:59:12 +0100 Message-ID: Subject: Re: CouchDB _bulk_docs allocating far more memory than needed? From: Dave Cottlehuber To: user@couchdb.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On 27 January 2012 22:05, Shawn Chidester wrote: > I'm attempting to post a single 150 MB document to my couchdb server. =A0= The > application that does the post usually has more than one document to post= so it > always uses _bulk_docs, even for one document. > > According to the crash message the couchdb server (or erlang) is tring to > allocate 4 GB or memory for this 150 MB post. Hi Shawn, It may be related to https://issues.apache.org/jira/browse/COUCHDB-1258 What Erlang + Couch release are you running? On which platform? The current git 1.2.x branch contains rnewson's fix. If you're able to, try building from source & test again. You will likely need just this doc, + the related design docs for views. A+ Dave