Return-Path: X-Original-To: apmail-directory-users-archive@www.apache.org Delivered-To: apmail-directory-users-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A5FDC104C4 for ; Fri, 27 Dec 2013 14:59:27 +0000 (UTC) Received: (qmail 79880 invoked by uid 500); 27 Dec 2013 14:58:37 -0000 Delivered-To: apmail-directory-users-archive@directory.apache.org Received: (qmail 79799 invoked by uid 500); 27 Dec 2013 14:58:30 -0000 Mailing-List: contact users-help@directory.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@directory.apache.org Delivered-To: mailing list users@directory.apache.org Received: (qmail 79791 invoked by uid 99); 27 Dec 2013 14:58:27 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 27 Dec 2013 14:58:27 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of ayyagarikiran@gmail.com designates 74.125.82.175 as permitted sender) Received: from [74.125.82.175] (HELO mail-we0-f175.google.com) (74.125.82.175) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 27 Dec 2013 14:58:21 +0000 Received: by mail-we0-f175.google.com with SMTP id t60so8147962wes.20 for ; Fri, 27 Dec 2013 06:58:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=LPLayOwnn16lHZvAJuD9ReeWVzk0zbcjI6nOUzo6+r4=; b=hO/NhcUYNcG3HlpYLCNSWlqpKa/iZbyIpSD9nlP9Ke2WY5vwp5me6m2Pp0khDrFM4I vK95fjFlRH4X/sYgnufmCpatDjOcoRzlY+lWytsmXLjxaYbNgg8ubSB6HDhJeEOWb4gX 9CS944r6YVpIF1hmTFMcagyKJgL+VRBxTAJUZNPuF8Ydiaja0L9Ag5BONLyl/1ytz55P vRb2QTBa4ObaLCRXgKIdE5hSFsL4NNGCkaJiYYQUcJpYxdouQ8sWDY6rJRmaOnie3s6V jQE4ecM3Zre5czozdzaZ8fDRlzZZ1lMGrK29Gpan4y/IYV+1nkDhWONgMTCoCrFYOboO UOlA== MIME-Version: 1.0 X-Received: by 10.180.74.142 with SMTP id t14mr17420547wiv.15.1388156281427; Fri, 27 Dec 2013 06:58:01 -0800 (PST) Sender: ayyagarikiran@gmail.com Received: by 10.216.166.194 with HTTP; Fri, 27 Dec 2013 06:58:01 -0800 (PST) In-Reply-To: References: <7754BDD9-D43C-435D-BF4A-2A97E2994B75@eacg.de> Date: Fri, 27 Dec 2013 20:28:01 +0530 X-Google-Sender-Auth: mDvGw4_GTbF5hmwx8ZIHjbh4rRU Message-ID: Subject: Re: Performance and Replication Questions From: Kiran Ayyagari To: Kiran Ayyagari Cc: users@directory.apache.org, "Frank J. Langel" , Stefan Pokorny Content-Type: multipart/alternative; boundary=14dae9cc93dc0c1ded04ee85522b X-Virus-Checked: Checked by ClamAV on apache.org --14dae9cc93dc0c1ded04ee85522b Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On Fri, Dec 13, 2013 at 12:43 AM, Kiran Ayyagari wrot= e: > > > > On Mon, Dec 9, 2013 at 8:28 PM, Kiran Ayyagari wrot= e: > >> >> >> >> On Mon, Dec 9, 2013 at 5:29 PM, J=F6rg Maa=DF wrot= e: >> >>> Dear all, >>> >>> thanks or your kind and quick help so far. However, there are still >>> questions open from our side, and your help in answering them is greatl= y >>> appreciated. We currently have the following setup: >>> 2 * Dell PowerEdge R815/II with 64 GB Memory and 2 * AMD Opteron 6172 >>> with 12 Cores, 512k Cache and 2.1 GHz, 4x600 GB SAS >>> ApacheDS 2.0 M15 >>> Oracle JVM 1.7.0-25 >>> Memory parameters for the ApacheDS JVM: -Xms2048m -Xmx2048m >>> 30 nbthreads to handle the LDAP requests >>> Indexes on all attributes that are searched (created BEFORE the data wa= s >>> loaded, size 10000) >>> Ca. 20000 objects in the central partition >>> Cache size for the partition: 10000 >>> Do you have any indication as to how many parallel BIND sessions and >>> searches we can support with such a setup? Is there a performance >>> whitepaper of any sort for ApacheDS (or similar information)? If so: wh= ere >>> can we find it? >>> >>> Additionally, we are experiencing regular trouble with replication in >>> our Multi Master Replication setup: If any of the servers is offline fo= r a >>> longer period of time, it will crash when booting up again and will del= ete >>> all information in the partition that is being replicated. Just this >>> weekend, the havoc was even greater: the partition was totally destroye= d >>> AND the server that was online all the time refused to start ApacheDS >>> again, because the partition data on disk was destroyed. >>> >>> how long the server was offline? before I guess on what would have >> caused this I would like >> to reproduce this issue in my lab and then will let you know the reason >> or the fix to avoid >> this. I would appreciate if you can share any logs related to this >> error. >> > I have found the issue which might be the reason for this issue. > It is due to sending entries to the client (i.e., a slave or another > master peer) in a random order. > I will commit a fix by the weekend and let you know. > this issue is fixed in the trunk, (the "weekend" took a long time to come due to the complexity involved in handling this issue) appreciate if you can test and let us know, thank you > Of course, we followed the published documentation when setting up the >>> servers and have unique replication IDs for our servers, etc. The syste= m >>> times are synchronized via NTP. >>> >>> We where able to restore the data from backup, but this clearly >>> disqualifies ApacheDS as a production ready system. >>> >>> Can you give us any hints as to avoid such a catastrophic scenario in >>> the future? >>> >>> it is premature to suggest anything at this moment, I will get back to >> you as soon as I have an answer (max a day). >> >>> Your help is greatly appreciated. >>> >>> >>> Kind regards >>> >>> >>> >>> J=F6rg Maa=DF >>> -- >>> T: +49 6027 409219 >>> M: +49 178 5352364 >>> F: +49 6027 409220 >>> W: http://www.eacg.de >>> ---- >>> EACG GmbH >>> Enterprise Architecture Consulting Group >>> OpernTurm 16.OG, Bockenheimer Landstra=DFe 2-4, 60306 Frankfurt am Main >>> Handelsregister Frankfurt am Main HRB 84852 >>> Gesch=E4ftsf=FChrer: Jan Thielscher >>> >>> >> >> >> -- >> Kiran Ayyagari >> http://keydap.com >> > > > > -- > Kiran Ayyagari > http://keydap.com > --=20 Kiran Ayyagari http://keydap.com --14dae9cc93dc0c1ded04ee85522b--