Return-Path: X-Original-To: apmail-couchdb-user-archive@www.apache.org Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4FB2210EB4 for ; Fri, 4 Oct 2013 12:43:13 +0000 (UTC) Received: (qmail 21287 invoked by uid 500); 4 Oct 2013 12:43:10 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 21000 invoked by uid 500); 4 Oct 2013 12:43:04 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 20988 invoked by uid 99); 4 Oct 2013 12:43:01 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 Oct 2013 12:43:01 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of ramkrishna.kulkarni@gmail.com designates 209.85.223.182 as permitted sender) Received: from [209.85.223.182] (HELO mail-ie0-f182.google.com) (209.85.223.182) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 Oct 2013 12:42:56 +0000 Received: by mail-ie0-f182.google.com with SMTP id aq17so8960494iec.13 for ; Fri, 04 Oct 2013 05:42:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=HfULucfp0/9ixGjxYtQcR+nwIULMytk5QhMMj17COXM=; b=fR7CfQDvuNiz/nDlGXv+SdnR0ykj5YqXc+ELABdiwCSnVPe9SnQYvug7Ab2Vo1Ndfz b09mI51Sz9pcgDsEuMbNhofa1dlESUDugY85/Fbv5WKgZpZGi+J1ADai1+L26zWy5sSG 4dV9va+v5+mntgI0pDarqvT7IVV+q+u43C01Ykd4aRd1mdmMkbho+uPoR5CZqLWt+Mwy jHk8gV9WJrU3l2eRd/m3FZkkhhFIO20xBQCq+b/3krB7qDqJF7inEfMuWNjgpcLF0V/B +jKxx6wHRPF76sPdHpSqO+TOwjFaezG/CmkfYtONxyn+ocZWQGdL3laBZ40UprCXeiqP DrKg== MIME-Version: 1.0 X-Received: by 10.42.189.201 with SMTP id df9mr727417icb.54.1380890555433; Fri, 04 Oct 2013 05:42:35 -0700 (PDT) Received: by 10.64.76.198 with HTTP; Fri, 4 Oct 2013 05:42:35 -0700 (PDT) In-Reply-To: <414026A1-6D62-46D5-977D-429B069B0D29@apache.org> References: <414026A1-6D62-46D5-977D-429B069B0D29@apache.org> Date: Fri, 4 Oct 2013 18:12:35 +0530 Message-ID: Subject: Re: Performance - Initiating over 100 simultaneous replications. From: Ramkrishna Kulkarni To: user@couchdb.apache.org Content-Type: multipart/alternative; boundary=20cf303bfb1e07cb1804e7e9a3a8 X-Virus-Checked: Checked by ClamAV on apache.org --20cf303bfb1e07cb1804e7e9a3a8 Content-Type: text/plain; charset=ISO-8859-1 That worked! I can now see thousands of connections. Thanks a lot. On Fri, Oct 4, 2013 at 4:01 PM, Robert Newson wrote: > One common gotcha with limits.conf is that couchdb su's to the couchdb > user and /etc/pam.d/su in debian/ubuntu defaults to *not* respecting > limits.conf, you need to enable it. > > B. > > On 4 Oct 2013, at 02:38, Ramkrishna Kulkarni < > ramkrishna.kulkarni@gmail.com> wrote: > > > I'm initiating over 100 one shot replications to as many servers from a > > central server. When I do this, central CouchDB slows down a lot > (Requests > > to DBs time out) even though enough system resources are available. I do > > not see more than 600 connections (netstat -an | grep -i established | wc > > -l) being opened at the time of replication. My config looks something > like > > this: > > > > [couchdb] > > max_dbs_open = 10000 > > > > [httpd] > > max_connections = 10240 > > > > [replicator] > > worker_processes = 30 > > http_connections = 30 > > > > /etc/security/limits.conf > > * - nofile 65535 > > > > ulimit -n > > 65535 > > > > This is CouchDB 1.4.x on Ubuntu 12.04 32-bit, 8-cores, 6GB RAM. > > > > I was hoping to see at least 3000 connections - 30 per replication. Is > > there some other config I'm missing? > > > > Thanks, > > Ram > > --20cf303bfb1e07cb1804e7e9a3a8--