From users-return-4588-apmail-directory-users-archive=directory.apache.org@directory.apache.org Fri Apr 13 21:06:01 2012 Return-Path: X-Original-To: apmail-directory-users-archive@www.apache.org Delivered-To: apmail-directory-users-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6759D9B79 for ; Fri, 13 Apr 2012 21:06:01 +0000 (UTC) Received: (qmail 56240 invoked by uid 500); 13 Apr 2012 21:06:01 -0000 Delivered-To: apmail-directory-users-archive@directory.apache.org Received: (qmail 56205 invoked by uid 500); 13 Apr 2012 21:06:01 -0000 Mailing-List: contact users-help@directory.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@directory.apache.org Delivered-To: mailing list users@directory.apache.org Received: (qmail 56197 invoked by uid 99); 13 Apr 2012 21:06:01 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 13 Apr 2012 21:06:01 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of elecharny@gmail.com designates 74.125.82.44 as permitted sender) Received: from [74.125.82.44] (HELO mail-wg0-f44.google.com) (74.125.82.44) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 13 Apr 2012 21:05:55 +0000 Received: by wgbdr13 with SMTP id dr13so3403863wgb.1 for ; Fri, 13 Apr 2012 14:05:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:reply-to:user-agent:mime-version:to:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=aTi6UN1IowohFpeFeCLZZR6NVxJOf5tpdgmjNrKPuF8=; b=FB4P5bDpPI2djjJ0UT3ZsBW+ZrL6EFgn8oxTVaTGDRGt//FfsNxSzK/xQcBoPa/z3N ok8qs5o0PDFXxsKyU4tGbnvRlbybhBchfwvo4PZMSs1MZInvbpdzMdcwcaPwOAkx8JTj X0FATSRjm2ijhPwnhioTlygpZIb2/tpAWHltPx4nWDalWAf96NBOYT/03IYb/0bRg5Os B5gIWZEuWsztFz6SDjln7ylh9F3hcIACc+FHzeQYDiLnQsOSaCDfmEdouM0BV8T3RlYd yGUA815P4AqRObg/o4N0aeM89V3JCHJuFYCtkMuNHaCQFsn0vpMABUj4RRLwLgIu4ZBq ARgQ== Received: by 10.216.138.223 with SMTP id a73mr1777449wej.86.1334351134112; Fri, 13 Apr 2012 14:05:34 -0700 (PDT) Received: from Emmanuels-MacBook-Pro.local (ran75-1-78-192-106-184.fbxo.proxad.net. [78.192.106.184]) by mx.google.com with ESMTPS id k6sm7457096wiy.7.2012.04.13.14.05.32 (version=SSLv3 cipher=OTHER); Fri, 13 Apr 2012 14:05:32 -0700 (PDT) Message-ID: <4F88951C.9090302@gmail.com> Date: Fri, 13 Apr 2012 23:05:32 +0200 From: =?UTF-8?B?RW1tYW51ZWwgTMOpY2hhcm55?= Reply-To: elecharny@apache.org User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:11.0) Gecko/20120327 Thunderbird/11.0.1 MIME-Version: 1.0 To: users@directory.apache.org Subject: Re: Update 2.0.0-M7 and indexes References: <2BE7E81B77921F43A6A273C2DF2FA6A43C4CC0EC36@IBSMBX.ibs-ag.com> In-Reply-To: <2BE7E81B77921F43A6A273C2DF2FA6A43C4CC0EC36@IBSMBX.ibs-ag.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Virus-Checked: Checked by ClamAV on apache.org Le 4/13/12 10:03 PM, Carlo.Accorsi@ibs-ag.com a écrit : > Hi Folks, we've made a lot of progress but it wouldn't be fun if there wasn't one more gotcha. :) > > We Built 2.0.0-M7 SHAPSHOT from the trunk and it installs and runs fine with 1GB memory / 32 bit JVM (Thanks Kiran for pointers last night) > I create a partition and index several attributes. When the server restarts the user attribute DBM databases appear ! (Thanks Emmanuel) > I load my ldif file with 80 k users. When the ldif is loaded, I can see all 80k users, everything seems fine, the indexes are populated I can search and it all works. Performances are good, I hope... > > Once I shut down the server, it will not restart. The wrapper fails with the error below. The size of the JVM goes from zero to 1.3GB, pauses and exists. > I'm sure there's an OutOfMemory exception occurring but even with Debug it's not appearing in the logs. > > The question I have is with a partition this size, with this number of users, what can I do to make the jvm as small as possible to start? > > I've reset all my attribute indexes to 100, partition cache is set to 1000 BEFORE I loaded all the users. Still having same result. > Any ideas? Many thanks. grmblgtmbl :/ I need to check what's going on when the serve ris stopped and restarted. This is clearly a bug, and it should be easy to fix. The thing is that this is a work in progress, and we have modified many things in the index area recently. This should not too much time to get a clue about what's going on and to fix the issue. I'l give it a try this week-end. At least, we are making progress ! Thanks for the info and the follow-up, this is really helpful for us. -- Regards, Cordialement, Emmanuel Lécharny www.iktek.com