Return-Path: X-Original-To: apmail-couchdb-user-archive@www.apache.org Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 05893FFCB for ; Sat, 5 Oct 2013 09:09:01 +0000 (UTC) Received: (qmail 16010 invoked by uid 500); 5 Oct 2013 09:08:51 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 15943 invoked by uid 500); 5 Oct 2013 09:08:44 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 15934 invoked by uid 99); 5 Oct 2013 09:08:42 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 05 Oct 2013 09:08:42 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jens.rantil@gmail.com designates 209.85.217.170 as permitted sender) Received: from [209.85.217.170] (HELO mail-lb0-f170.google.com) (209.85.217.170) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 05 Oct 2013 09:08:36 +0000 Received: by mail-lb0-f170.google.com with SMTP id w7so4130627lbi.29 for ; Sat, 05 Oct 2013 02:08:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=df5/tKZO+q2vsXOUh9Nu53uTroOOU0nG1u6elWkiSmw=; b=Rmkr/xKFzG4VqeckSNMk1a7JDEx0OhTVTlebPhnToAP2cLAZ93IP3Tsl1Sl500EIt3 lzRH36vHKWLZvIFc6XD0HDWCp3wiw7qyWWTRP6rcmw5qNqlsLDfIvW0mB1hhCXLzH1wV 4XtTqCb07evPsFuagPBFMfAFzqSH4BAk0AO7TKAnS/gT27N+8bd9gOGgz/pNGJKH/19G +HF4scIzVhvb8JIOyWwVX+p/aWPOcCrU2yU4ui611YK765Lu0SzRdo0lzSfrsXaRcgOG lFj/UuXuFdjVtSWQTZNBC58T4PawOpt5NwB15qAIuEj1WH6CrucB923OFU/7yefFsfFO opGg== X-Received: by 10.112.72.229 with SMTP id g5mr15698319lbv.10.1380964094616; Sat, 05 Oct 2013 02:08:14 -0700 (PDT) MIME-Version: 1.0 Received: by 10.112.17.1 with HTTP; Sat, 5 Oct 2013 02:07:54 -0700 (PDT) In-Reply-To: References: <414026A1-6D62-46D5-977D-429B069B0D29@apache.org> From: Jens Rantil Date: Sat, 5 Oct 2013 11:07:54 +0200 Message-ID: Subject: Re: Performance - Initiating over 100 simultaneous replications. To: "user@couchdb.apache.org" Content-Type: multipart/alternative; boundary=001a11c238e84eaa3204e7fac234 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c238e84eaa3204e7fac234 Content-Type: text/plain; charset=ISO-8859-1 Ramkrishna, Just curious, what did you set the limits to for this to work? Cheers, Jens On Fri, Oct 4, 2013 at 2:42 PM, Ramkrishna Kulkarni < ramkrishna.kulkarni@gmail.com> wrote: > That worked! I can now see thousands of connections. Thanks a lot. > > > On Fri, Oct 4, 2013 at 4:01 PM, Robert Newson wrote: > > > One common gotcha with limits.conf is that couchdb su's to the couchdb > > user and /etc/pam.d/su in debian/ubuntu defaults to *not* respecting > > limits.conf, you need to enable it. > > > > B. > > > > On 4 Oct 2013, at 02:38, Ramkrishna Kulkarni < > > ramkrishna.kulkarni@gmail.com> wrote: > > > > > I'm initiating over 100 one shot replications to as many servers from a > > > central server. When I do this, central CouchDB slows down a lot > > (Requests > > > to DBs time out) even though enough system resources are available. I > do > > > not see more than 600 connections (netstat -an | grep -i established | > wc > > > -l) being opened at the time of replication. My config looks something > > like > > > this: > > > > > > [couchdb] > > > max_dbs_open = 10000 > > > > > > [httpd] > > > max_connections = 10240 > > > > > > [replicator] > > > worker_processes = 30 > > > http_connections = 30 > > > > > > /etc/security/limits.conf > > > * - nofile 65535 > > > > > > ulimit -n > > > 65535 > > > > > > This is CouchDB 1.4.x on Ubuntu 12.04 32-bit, 8-cores, 6GB RAM. > > > > > > I was hoping to see at least 3000 connections - 30 per replication. Is > > > there some other config I'm missing? > > > > > > Thanks, > > > Ram > > > > > --001a11c238e84eaa3204e7fac234--