Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@couchdb.apache.org
Received-SPF: pass (nike.apache.org: domain of randall.leeds@gmail.com
 designates 209.85.216.52 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=pJdGPXITlND0ZRl1DB3zVahsrpzyHg+x4b+65zUxZ9wqbyoKcXF+HEJ2gTXZfgh9PR
         6cod1lv03Bs4heMCyoPspWriihrzexLlVhtW4EDda9tcAhaX7XHzQzhKIAXz51BCXSun
         SBzOwdcTc4NeCfEGhZwdfieqQwJbWQXmdZsm0=
MIME-Version: 1.0
In-Reply-To: <AANLkTil5SrCg5OOHOwVMkEk5JcBrftbXbcQV9eIOxCFt@mail.gmail.com>
References: <AANLkTilWMvp9Lrv3kP0wM1Lcly159c5i_uVTpZIM9vGO@mail.gmail.com>
	<A35DE872-9D3C-42EB-B498-EBA1C0053D6B@dionne-associates.com>
	<AANLkTil5SrCg5OOHOwVMkEk5JcBrftbXbcQV9eIOxCFt@mail.gmail.com>
Date: Thu, 15 Jul 2010 17:02:20 -0700
Message-ID: <AANLkTine7celMwBSbqUBx1dciWIQp5fCo13lOht6uBqm@mail.gmail.com>
Subject: Re: Trying to get 5000+ databases replicating, no success thus far.
From: Randall Leeds <randall.leeds@gmail.com>
To: user@couchdb.apache.org
Content-Type: text/plain; charset=UTF-8

You will want to set max_connections even higher.
If you look in the [replicator] section of the ini you'll notice that
each replication can use up to 10 connections plus the changes feed,
so try bumping max_connections beyond 55,000.

Finally, what system are you running this on?
For example, on CentOS, the daemon function comes from
/etc/rc.d/init.d/functions and it will call "runuser" to switch to the
couchdb user and pass a "-" in the call, which creates a login shell.

runuser is much like su. From `info su`:
`-'
`-l'
`--login'
     Make the shell a login shell.  This means the following.  Unset all
     environment variables except `TERM', `HOME', and `SHELL' (which
     are set as described above), and `USER' and `LOGNAME' (which are
     set, even for the super-user, as described above), and set `PATH'
     to a compiled-in default value.  Change to USER's home directory.
     Prepend `-' to the shell's name, intended to make it read its
     login startup file(s).  Additionaly `DISPLAY' and `XAUTHORITY'
     environment variables are preserved as well for PAM functionality.

However, couch still needs to be started from a directory where it can
run "find", i.e. a directory it has permission to read and a non-login
shell won't switch to the users home directory.

Here's a snippet of my CentOS init script:

cd $(eval echo ~$COUCHDB_USER)
su $COUCHD_USER -c "$exec \
   -r $COUCHDB_RESPAWN_TIMEOUT \
   ....

Could this be your issue?

-Randall

On Thu, Jul 15, 2010 at 16:41, Chris Stockton <chrisstocktonaz@gmail.com> wrote:
> Hello,
>
> On Thu, Jul 15, 2010 at 4:27 PM, Robert Dionne
> <dionne@dionne-associates.com> wrote:
>> I've seen this message before when using mnesia, the default for ets tables is 1400. You might try setting the environment variable:
>>
>> ERL_MAX_ETS_TABLES
>>
>> to something higher
>>>
>>> These exist in my couchdb init script:
>>> ulimit -n 1000000
>>> export ERL_MAX_PORTS=100000
>>> export ERL_MAX_ETS_TABLES=10000
>
> Thank you Dionne, I actually have "export ERL_MAX_ETS_TABLES=10000"
> currently inside my init script. I am under the impression this is
> properly being read when couch starts, but maybe I need to pass them
> as flags to couchdb binary in my daemon command?
>
> -Chris
>