From user-return-4678-apmail-couchdb-user-archive=couchdb.apache.org@couchdb.apache.org Fri May 01 20:42:11 2009 Return-Path: Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: (qmail 60265 invoked from network); 1 May 2009 20:42:10 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 1 May 2009 20:42:10 -0000 Received: (qmail 18058 invoked by uid 500); 1 May 2009 20:42:08 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 18011 invoked by uid 500); 1 May 2009 20:42:08 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 17975 invoked by uid 99); 1 May 2009 20:42:08 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 May 2009 20:42:08 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [128.200.36.30] (HELO translab.its.uci.edu) (128.200.36.30) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 May 2009 20:42:01 +0000 Received: from translab.its.uci.edu (localhost.localdomain [127.0.0.1]) by translab.its.uci.edu (8.13.1/8.12.10) with ESMTP id n41KfZgc016224 for ; Fri, 1 May 2009 13:41:35 -0700 Received: (from jmarca@localhost) by translab.its.uci.edu (8.13.1/8.13.1/Submit) id n41KfYDM016223 for user@couchdb.apache.org; Fri, 1 May 2009 13:41:34 -0700 Date: Fri, 1 May 2009 13:41:34 -0700 From: James Marca To: user@couchdb.apache.org Subject: possible bug using bulk docs? Message-ID: <20090501204134.GA12379@translab.its.uci.edu> Mail-Followup-To: user@couchdb.apache.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.1i X-ITS-MailScanner: Found to be clean X-ITS-MailScanner-From: jmarca@translab.its.uci.edu X-ITS-Spam-Status: No X-Virus-Checked: Checked by ClamAV on apache.org Hi All, I'm getting an out of memory type of crash when uploading lots of files using bulk docs, and I'm wondering whether this is a known issue or user error. I set the logging to debug and this is what I see: [Fri, 01 May 2009 20:27:30 GMT] [debug] [<0.108.0>] 'POST' /d12_june2007/_bulk_docs {1,1} Headers: [{'Connection',"TE, close"}, {'Content-Length',"257418477"}, {'Host',"127.0.0.1:5984"}, {"Te","deflate,gzip;q=0.3"}, {'User-Agent',"libwww-perl/5.805"}] [Fri, 01 May 2009 20:31:01 GMT] [info] [<0.108.0>] 127.0.0.1 - - 'POST' /d12_june2007/_bulk_docs 201 In top I can watch the RAM usage go up and down until finally it peaks and the server is just gone. That content length is from 1278 documents. I can easily split that pile up into fewer documents (and that is what I am going to do) but I thought I'd raise the issue here as this feels like a software bug somewhere. I am running the release 0.9, on Gentoo, using the gentoo ebuild, x86_64 using the latest (compiled yesterday) release of erlang on gentoo. I'm more than happy to pull new code from git or svn to test things out too. Regards, James -- James E. Marca Researcher Institute of Transportation Studies AIRB Suite 4000 University of California Irvine, CA 92697-3600 jmarca@translab.its.uci.edu -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean.