Return-Path: X-Original-To: apmail-couchdb-user-archive@www.apache.org Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 88F2290F8 for ; Fri, 23 Mar 2012 11:22:29 +0000 (UTC) Received: (qmail 16607 invoked by uid 500); 23 Mar 2012 11:22:28 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 16560 invoked by uid 500); 23 Mar 2012 11:22:28 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 16551 invoked by uid 99); 23 Mar 2012 11:22:28 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 23 Mar 2012 11:22:28 +0000 X-ASF-Spam-Status: No, hits=3.6 required=5.0 tests=FROM_LOCAL_NOVOWEL,HK_RANDOM_ENVFROM,HK_RANDOM_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of cgsmcmlxxv@gmail.com designates 209.85.216.180 as permitted sender) Received: from [209.85.216.180] (HELO mail-qc0-f180.google.com) (209.85.216.180) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 23 Mar 2012 11:22:20 +0000 Received: by qcsd15 with SMTP id d15so2169706qcs.11 for ; Fri, 23 Mar 2012 04:22:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=vqTaEg/hrbZ9t2B9hn/046TV0vIBYNuNLl2JONCTWyc=; b=N0pxUPAQ+u6jQcQ2YHbVmT/5nC/q3s1rIac20BO98B4R7K9vot/eyXJOug4WUpVFF/ lgU5/yHxTvHbJPhXsxeT0cYuSWxHKQsVFdY/yxSTjWsJc+SiLGWQSGtKyskm3hx+TYVf LjhiaqxBISnH/AQX5VtdntuwbgHAXbdLOurQ8oJPD9+QM6yjZx5XdqjFxz2wWQwid54S Ciz71fhAf/p3cslPYOmQTE3nkGxIxShj10bT9O8Rz7+mtRvFv6shZ2nPrENYytxhHLOm ClgRe1CoEWMm5xVLUrjygRCFQzX+lNqBEG3xk7grKkpsCux16/t3YRF34eJjo8X2g1IO 2wzQ== MIME-Version: 1.0 Received: by 10.224.116.197 with SMTP id n5mr15405420qaq.3.1332501719931; Fri, 23 Mar 2012 04:21:59 -0700 (PDT) Received: by 10.229.28.138 with HTTP; Fri, 23 Mar 2012 04:21:59 -0700 (PDT) In-Reply-To: References: Date: Fri, 23 Mar 2012 12:21:59 +0100 Message-ID: Subject: Re: Why are reads from CouchDB so slow? (1.5MB/s or thereabouts) From: CGS To: user@couchdb.apache.org Content-Type: multipart/alternative; boundary=20cf3074d95caddc4204bbe73ba6 X-Virus-Checked: Checked by ClamAV on apache.org --20cf3074d95caddc4204bbe73ba6 Content-Type: text/plain; charset=ISO-8859-1 ...also, it would be nice to know how you inserted the documents and if they have attachments (at that size, I suppose they have). Could you also provide a result from ping 127.0.0.1 for response time fluctuations? CGS On Fri, Mar 23, 2012 at 12:16 PM, Jason Smith wrote: > Hi, Jonathan. > > Can we start by identifying how fast you think **is** reasonable. What > speeds were you expecting? And on what grounds do you base that > expectation? > > (For example, perhaps connecting and fetching one row from MySQL?) > > On Fri, Mar 23, 2012 at 11:06 AM, Jonathan Williamson > wrote: > > Hi everyone, > > > > I posted this question on Stack Overflow and Jason Smith suggested I > > try this group instead. > > > >> I have a CouchDB (1.1.1) server running that contains a lot of > documents in the 400-600KB size range. > >> > >> If I time fetching a full document from the database (not from a view, > just the raw document) it takes 200-400ms to complete which equates to > around 1.5MB/s throughput. > >> > >> If I write the same data to raw files on disk they load in 10-20ms > (around 25-50 MB/s). > >> > >> I'd expect CouchDB to have some overhead, but an order of magnitude > (and some) seems crazy for what is essentially a read! > >> > >> Can anyone shed some light onto why this might be the case? > >> > >> Update: As requested below, a timing from curl: > >> > >> # time curl http://localhost:5984/[dbname]/[documentname] > >> > >> real 0m0.684s > >> user 0m0.004s > >> sys 0m0.020s > >> > >> The fetched document was 642842 bytes. I've tested it on both a > standard 1TB harddisk and an EC2 instance (EBS volume) with similar results. > > > > There was some discussion about the post which can be found here: > > > http://stackoverflow.com/questions/9807200/why-are-reads-from-couchdb-so-slow-1-5mb-s-or-thereabouts > > > > Thanks, > > > > Jon. > > > > -- > Iris Couch > --20cf3074d95caddc4204bbe73ba6--