Return-Path: Delivered-To: apmail-couchdb-dev-archive@www.apache.org Received: (qmail 90196 invoked from network); 9 Oct 2010 19:46:51 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 9 Oct 2010 19:46:51 -0000 Received: (qmail 74681 invoked by uid 500); 9 Oct 2010 19:46:31 -0000 Delivered-To: apmail-couchdb-dev-archive@couchdb.apache.org Received: (qmail 74598 invoked by uid 500); 9 Oct 2010 19:46:31 -0000 Mailing-List: contact dev-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@couchdb.apache.org Delivered-To: mailing list dev@couchdb.apache.org Received: (qmail 74560 invoked by uid 99); 9 Oct 2010 19:46:31 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 09 Oct 2010 19:46:31 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 09 Oct 2010 19:46:30 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id o99JkAPn017295 for ; Sat, 9 Oct 2010 19:46:10 GMT Message-ID: <11549868.58861286653570674.JavaMail.jira@thor> Date: Sat, 9 Oct 2010 15:46:10 -0400 (EDT) From: "Paul Joseph Davis (JIRA)" To: dev@couchdb.apache.org Subject: [jira] Updated: (COUCHDB-768) Constant Bulk Saving results in Eventual Timeouts In-Reply-To: <24330696.12951274274233698.JavaMail.jira@thor> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/COUCHDB-768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Joseph Davis updated COUCHDB-768: -------------------------------------- Skill Level: Regular Contributors Level (Easy to Medium) > Constant Bulk Saving results in Eventual Timeouts > ------------------------------------------------- > > Key: COUCHDB-768 > URL: https://issues.apache.org/jira/browse/COUCHDB-768 > Project: CouchDB > Issue Type: Bug > Components: HTTP Interface > Affects Versions: 0.10.2, 0.11 > Environment: Software: Using Python 2.6 (couchdbkit OR httplib) OR curl to submit. The 0.11 is the Debian unstable version; the 0.10.2 install is from Ubuntu. > CouchDB 0.11 is running on a Sun Fire X4600 M2, with NFS mounted storage to a Linux software RAID10 (x4 WD20EARS SATA drives). However, same issue arises using the server's 3G/s (10k RPM) SAS drives. The NFS share is mounted over dual intel gigabit NICs in a round-robin configuration. > Reporter: A.W. Stanley > Priority: Minor > > Situation: > Saving documents in bulk (lots of 1,000, 4,000, and 10,000 have been tested) to a single database results in degraded performance, and then a string of timeouts. The timeouts are not logged by CouchDB, so the HTTP interface becomes unusable for a period. It then returns and rapidly processes the next batch of jobs (read: the timeout is temporary). > Replication: > - I am having trouble replicating the behaviour with saving bulk loads of documents (I have been working against doing so), but it appears to happen after an extended period; > - I can replicate the behaviour by submitting a lot of individual files (single document saves) in rapid succession. > Diagnostics: > - I had tried true and false for delayed_commits, just to rule that out; > - Testing outside of CouchDB (postgres, file transfers, streaming, or otherwise trying to hammer the I/O) yielded no issues with the systems involved. > Functional Workarounds: > - I have sharded the database in question. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.