Return-Path: Delivered-To: apmail-jackrabbit-users-archive@minotaur.apache.org Received: (qmail 46047 invoked from network); 25 Aug 2010 12:02:22 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 25 Aug 2010 12:02:22 -0000 Received: (qmail 1903 invoked by uid 500); 25 Aug 2010 12:02:21 -0000 Delivered-To: apmail-jackrabbit-users-archive@jackrabbit.apache.org Received: (qmail 1679 invoked by uid 500); 25 Aug 2010 12:02:20 -0000 Mailing-List: contact users-help@jackrabbit.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@jackrabbit.apache.org Delivered-To: mailing list users@jackrabbit.apache.org Received: (qmail 1670 invoked by uid 99); 25 Aug 2010 12:02:19 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 25 Aug 2010 12:02:19 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [194.172.26.33] (HELO MX1.aeb.de) (194.172.26.33) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 25 Aug 2010 12:02:14 +0000 X-IronPort-AV: E=Sophos;i="4.56,268,1280700000"; d="scan'208";a="5929778" Received: from unknown (HELO S-HQMX7.pmbelz.de) ([10.237.5.7]) by MX1I.pmbelz.de with ESMTP; 25 Aug 2010 14:01:51 +0200 Received: from S-HQMX7.pmbelz.de ([fe80::c4b6:4b67:cd89:2050]) by S-HQMX7.pmbelz.de ([fe80::c4b6:4b67:cd89:2050%15]) with mapi; Wed, 25 Aug 2010 14:01:51 +0200 From: "Seidel. Robert" To: "users@jackrabbit.apache.org" Date: Wed, 25 Aug 2010 14:01:50 +0200 Subject: AW: Lucene - out of memory Thread-Topic: Lucene - out of memory Thread-Index: ActEKL4NY3Ao0w9xTRasEsIWIZ1EcwAIc8yA Message-ID: References: In-Reply-To: Accept-Language: de-DE Content-Language: de-DE X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: de-DE Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Hi, the memory settings are: -Xms512m -Xmx1024m -XX:MaxPermSize=3D256m I'm using a 32bit OS. There were no queries made at that time. @Karl: How could you deactivate Lucene? When I remove the -Tag= from the configuration, I get such an error when trying to start the repos= itory: 2010-08-03 12:20:51,313 ERROR (AuthorizableImpl.java:371) - Failed to retri= eve membership references of User 'admin'. javax.jcr.RepositoryException: Unable to retrieve WEAKREFERENCE properties = that refer to 21232f29-7a57-35a7-8389-4a0e4a801fc3 at org.apache.jackrabbit.core.NodeImpl.getWeakReferences(NodeImpl.j= ava:3461) at org.apache.jackrabbit.core.security.user.AuthorizableImpl.getMem= bershipReferences(AuthorizableImpl.java:369) at org.apache.jackrabbit.core.security.user.AuthorizableImpl.collec= tMembership(AuthorizableImpl.java:312) at org.apache.jackrabbit.core.security.user.AuthorizableImpl.member= Of(AuthorizableImpl.java:100) at org.apache.jackrabbit.core.security.principal.DefaultPrincipalPr= ovider.collectGroupMembership(DefaultPrincipalProvider.java:290) at org.apache.jackrabbit.core.security.principal.DefaultPrincipalPr= ovider.getGroupMembership(DefaultPrincipalProvider.java:194) at org.apache.jackrabbit.core.security.authentication.AbstractLogin= Module.getPrincipals(AbstractLoginModule.java:676) at org.apache.jackrabbit.core.security.authentication.AbstractLogin= Module.commit(AbstractLoginModule.java:369) at org.apache.jackrabbit.core.security.authentication.LocalAuthCont= ext.login(LocalAuthContext.java:86) at org.apache.jackrabbit.core.RepositoryImpl.login(RepositoryImpl.j= ava:1497) at org.apache.jackrabbit.core.TransientRepository.login(TransientRe= pository.java:380) at org.apache.jackrabbit.commons.AbstractRepository.login(AbstractR= epository.java:123) at de.aeb.xnsg.archive.cr.jackrabbit.JRRepositoryManager.login(JRRe= positoryManager.java:129) at de.aeb.xnsg.cr.jackrabbit.concurrency.ConcurrencyScenario01Test.= initializeRepositoy(ConcurrencyScenario01Test.java:85) at de.aeb.xnsg.cr.jackrabbit.concurrency.ConcurrencyScenario01Test.= testNoIndex(ConcurrencyScenario01Test.java:64) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessor= Impl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethod= AccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at junit.framework.TestCase.runTest(TestCase.java:164) at junit.framework.TestCase.runBare(TestCase.java:130) at junit.framework.TestResult$1.protect(TestResult.java:106) at junit.framework.TestResult.runProtected(TestResult.java:124) at junit.framework.TestResult.run(TestResult.java:109) at junit.framework.TestCase.run(TestCase.java:120) at org.eclipse.jdt.internal.junit.runner.junit3.JUnit3TestReference= .run(JUnit3TestReference.java:130) at org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExec= ution.java:38) at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(= RemoteTestRunner.java:467) at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(= RemoteTestRunner.java:683) at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(Remot= eTestRunner.java:390) at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(Remo= teTestRunner.java:197) Caused by: javax.jcr.RepositoryException: no search manager configured for = this workspace at org.apache.jackrabbit.core.WorkspaceImpl.getQueryManager(Workspa= ceImpl.java:778) at org.apache.jackrabbit.core.NodeImpl.getWeakReferences(NodeImpl.j= ava:3445) ... 30 more Kindly regards, Robert Seidel -----Urspr=FCngliche Nachricht----- Von: Karl Meier [mailto:furzgesicht@gmail.com]=20 Gesendet: Mittwoch, 25. August 2010 09:40 An: users@jackrabbit.apache.org Betreff: Re: Lucene - out of memory We had the same issue. Additionally it's getting slower and slower. The onl= y way was to deactivate Lucene. On Wed, Aug 25, 2010 at 9:30 AM, Ard Schrijvers wrote: > Hello Robert, > > with how much memory is your application running? Are you also doing > searches at the same time? In specific, sorting on properties? > > Furthermore, Lucene is quite memory consuming, certainly the way > Jackrabbit is using it. You just have to make sure you have enough > memory > > Regards Ard > > On Wed, Aug 25, 2010 at 9:24 AM, Seidel. Robert > wrote: > > Hi, > > > > After storing a while data (about 80.000 nodes) into an CR, an out of > memory error occurred: > > > > 2010-08-25 00:22:58,439 ERROR (IndexMerger.java:568) - Error while > merging indexes: > > java.lang.OutOfMemoryError: Java heap space > > at java.util.HashMap.resize(HashMap.java:508) > > at java.util.HashMap.addEntry(HashMap.java:799) > > at java.util.HashMap.put(HashMap.java:431) > > at > org.apache.jackrabbit.core.query.lucene.CachingIndexReader$CacheInitializ= er$1.collect(CachingIndexReader.java:433) > > at > org.apache.jackrabbit.core.query.lucene.CachingIndexReader$CacheInitializ= er.collectTermDocs(CachingIndexReader.java:515) > > at > org.apache.jackrabbit.core.query.lucene.CachingIndexReader$CacheInitializ= er.initializeParents(CachingIndexReader.java:425) > > at > org.apache.jackrabbit.core.query.lucene.CachingIndexReader$CacheInitializ= er.run(CachingIndexReader.java:386) > > at > org.apache.jackrabbit.core.query.lucene.CachingIndexReader.(Caching= IndexReader.java:135) > > at > org.apache.jackrabbit.core.query.lucene.AbstractIndex.getReadOnlyIndexRea= der(AbstractIndex.java:315) > > at > org.apache.jackrabbit.core.query.lucene.MultiIndex.replaceIndexes(MultiIn= dex.java:665) > > at > org.apache.jackrabbit.core.query.lucene.IndexMerger$Worker.run(IndexMerge= r.java:551) > > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417) > > at > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269) > > at java.util.concurrent.FutureTask.run(FutureTask.java:123) > > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.acce= ss$301(ScheduledThreadPoolExecutor.java:65) > > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(= ScheduledThreadPoolExecutor.java:168) > > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor= .java:650) > > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav= a:675) > > at java.lang.Thread.run(Thread.java:595) > > > > If I add more properties or change the binary data mime type for full > text indexing, then I'll get the error sooner. > > > > If I quit the application and restart it, it works again for a while. I= t > seems to me, that lucene is stacking up memory. > > > > How can I handle that situation? > > > > Kindly regards, > > > > Robert Seidel > > >