Return-Path: Delivered-To: apmail-jackrabbit-users-archive@locus.apache.org Received: (qmail 17468 invoked from network); 28 Aug 2006 12:40:41 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 28 Aug 2006 12:40:41 -0000 Received: (qmail 83954 invoked by uid 500); 28 Aug 2006 12:40:41 -0000 Delivered-To: apmail-jackrabbit-users-archive@jackrabbit.apache.org Received: (qmail 83942 invoked by uid 500); 28 Aug 2006 12:40:41 -0000 Mailing-List: contact users-help@jackrabbit.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@jackrabbit.apache.org Delivered-To: mailing list users@jackrabbit.apache.org Received: (qmail 83933 invoked by uid 99); 28 Aug 2006 12:40:41 -0000 Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 28 Aug 2006 05:40:40 -0700 X-ASF-Spam-Status: No, hits=0.2 required=10.0 tests=FROM_NO_LOWER X-Spam-Check-By: apache.org Received-SPF: pass (asf.osuosl.org: local policy) Received: from [194.8.61.2] (HELO mailslot1.tirol.gv.at) (194.8.61.2) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 28 Aug 2006 05:40:39 -0700 X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Subject: AW: problems with re-indexing the workspace Date: Mon, 28 Aug 2006 14:40:15 +0200 Message-ID: X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: problems with re-indexing the workspace Thread-Index: AcbKnndMXFppRilVQXi8TGmypkbmXQAAGwKQ From: =?iso-8859-1?Q?K=D6LL_Claus?= To: X-OriginalArrivalTime: 28 Aug 2006 12:40:15.0729 (UTC) FILETIME=[1CBB5E10:01C6CA9F] X-Virus-Checked: Checked by ClamAV on apache.org X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N hi christian .. for information ... on my test case the behaviour is the same with the exceptions .. claus=20 -----Urspr=FCngliche Nachricht----- Von: Christian Zanata [mailto:christian.zanata@wavegroup.it]=20 Gesendet: Montag, 28. August 2006 14:35 An: users@jackrabbit.apache.org Betreff: Re: problems with re-indexing the workspace On Mon, 2006-08-28 at 14:50 +0300, Jukka Zitting wrote: > Hi, >=20 > On 8/28/06, Christian Zanata wrote: > > [ERROR] 20060825 17:06:40 > > (org.apache.jackrabbit.core.observation.ObservationManagerFactory) - > > Synchronous EventConsumer threw exception. = java.lang.OutOfMemoryError > > > > This error seems happening when the repository tries to re-index the > > workspace, but we don't have more stack traces. > > [...] > > could anybody heps us to understand what's happening? >=20 > There are two likely causes for that; either Lucene is running out of > memory while merging the index segments, or one of the index filters > runs out of memory trying to parse one of the binary documents in the > repository. Without a complete stack trace it is difficult to > determine the exact cause of the problems. >=20 Hi, in our stack-trace there are other orrors, but I don't know if this errors are related to this problem. First one is that Lucene have some problems indexing some MsOffice documents, but as i read on the internet it seems that the problem is that sometimes the extension .doc isn't related to a real .doc file. ------- [DEBUG] 20060803 08:24:01 (org.apache.jackrabbit.core.query.LazyReader) - Dump:=20 java.io.IOException: Invalid header signature; read 8656037701166316554, expected -2226271756974174256 at org.apache.jackrabbit.core.query.MsWordTextFilter $1.initializeReader(MsWordTextFilter.java:78) at org.apache.jackrabbit.core.query.LazyReader.read(LazyReader.java:79) at org.apache.lucene.analysis.standard.FastCharStream.refill(FastCharStream.= java:68) at org.apache.lucene.analysis.standard.FastCharStream.readChar(FastCharStrea= m.java:44) at org.apache.lucene.analysis.standard.FastCharStream.BeginToken(FastCharStr= eam.java:78) at org.apache.lucene.analysis.standard.StandardTokenizerTokenManager.getNext= Token(StandardTokenizerTokenManager.java:1105) at org.apache.lucene.analysis.standard.StandardTokenizer.jj_ntk(StandardToke= nizer.java:150) at org.apache.lucene.analysis.standard.StandardTokenizer.next(StandardTokeni= zer.java:28) at org.apache.lucene.analysis.standard.StandardFilter.next(StandardFilter.ja= va:40) at org.apache.lucene.analysis.LowerCaseFilter.next(LowerCaseFilter.java:32) at org.apache.lucene.analysis.StopFilter.next(StopFilter.java:98) at org.apache.lucene.index.DocumentWriter.invertDocument(DocumentWriter.java= :143) at org.apache.lucene.index.DocumentWriter.addDocument(DocumentWriter.java:81= ) at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:307) at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:294) at org.apache.jackrabbit.core.query.lucene.AbstractIndex.addDocument(Abstrac= tIndex.java:129) at org.apache.jackrabbit.core.query.lucene.VolatileIndex.commitPending(Volat= ileIndex.java:164) at org.apache.jackrabbit.core.query.lucene.VolatileIndex.addDocument(Volatil= eIndex.java:86) at org.apache.jackrabbit.core.query.lucene.MultiIndex $AddNode.execute(MultiIndex.java:1304) at org.apache.jackrabbit.core.query.lucene.MultiIndex.executeAndLog(MultiInd= ex.java:763) at org.apache.jackrabbit.core.query.lucene.MultiIndex.createIndex(MultiIndex= .java:838) at org.apache.jackrabbit.core.query.lucene.MultiIndex.createIndex(MultiIndex= .java:844) at org.apache.jackrabbit.core.query.lucene.MultiIndex.createIndex(MultiIndex= .java:844) at org.apache.jackrabbit.core.query.lucene.MultiIndex.createIndex(MultiIndex= .java:844) at org.apache.jackrabbit.core.query.lucene.MultiIndex.createIndex(MultiIndex= .java:844) at org.apache.jackrabbit.core.query.lucene.MultiIndex.createIndex(MultiIndex= .java:844) at org.apache.jackrabbit.core.query.lucene.MultiIndex.createIndex(MultiIndex= .java:844) at org.apache.jackrabbit.core.query.lucene.MultiIndex.createIndex(MultiIndex= .java:844) at org.apache.jackrabbit.core.query.lucene.MultiIndex.(MultiIndex.java= :271) at org.apache.jackrabbit.core.query.lucene.SearchIndex.doInit(SearchIndex.ja= va:218) at org.apache.jackrabbit.core.query.AbstractQueryHandler.init(AbstractQueryH= andler.java:43) at org.apache.jackrabbit.core.SearchManager.initializeQueryHandler(SearchMan= ager.java:529) at org.apache.jackrabbit.core.SearchManager.(SearchManager.java:273) at org.apache.jackrabbit.core.RepositoryImpl.getSystemSearchManager(Reposito= ryImpl.java:560) at org.apache.jackrabbit.core.RepositoryImpl.access $300(RepositoryImpl.java:84) at org.apache.jackrabbit.core.RepositoryImpl $WorkspaceInfo.getSearchManager(RepositoryImpl.java:1434) at org.apache.jackrabbit.core.RepositoryImpl.initWorkspace(RepositoryImpl.ja= va:540) at org.apache.jackrabbit.core.RepositoryImpl.(RepositoryImpl.java:245)= at org.apache.jackrabbit.core.RepositoryImpl.create(RepositoryImpl.java:484)= at org.apache.jackrabbit.core.jndi.BindableRepository.init(BindableRepositor= y.java:136) at org.apache.jackrabbit.core.jndi.BindableRepository.create(BindableReposit= ory.java:122) at org.apache.jackrabbit.core.jndi.BindableRepositoryFactory.createInstance(= BindableRepositoryFactory.java:58) at org.apache.jackrabbit.core.jndi.RegistryHelper.registerRepository(Registr= yHelper.java:59) at it.wavegroup.imco.services.RepositoryInitService.registerRepository(Unkno= wn Source) at it.wavegroup.imco.jackrabbit.RepositoryInit.startupRepository(Unknown Source) at it.wavegroup.imco.servlets.ApplicationInit.startupRepository(Unknown Source) at it.wavegroup.imco.servlets.ApplicationInit.contextInitialized(Unknown Source) at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.ja= va:3827) at org.apache.catalina.core.StandardContext.start(StandardContext.java:4343)= at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.jav= a:823) at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:807) at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:595) at org.apache.catalina.core.StandardHostDeployer.addChild(StandardHostDeploy= er.java:903) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java= :39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI= mpl.java:25) at java.lang.reflect.Method.invoke(Method.java:324) at org.apache.commons.beanutils.MethodUtils.invokeMethod(MethodUtils.java:21= 6) at org.apache.commons.digester.SetNextRule.end(SetNextRule.java:256) at org.apache.commons.digester.Rule.end(Rule.java:276) at org.apache.commons.digester.Digester.endElement(Digester.java:1058) at org.apache.catalina.util.CatalinaDigester.endElement(CatalinaDigester.jav= a:76) at org.apache.xerces.parsers.AbstractSAXParser.endElement(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanEndElement(Unkn= own Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl $FragmentContentDispatcher.dispatch(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknow= n Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source) at org.apache.commons.digester.Digester.parse(Digester.java:1567) at org.apache.catalina.core.StandardHostDeployer.install(StandardHostDeploye= r.java:488) at org.apache.catalina.core.StandardHost.install(StandardHost.java:863) at org.apache.catalina.startup.HostConfig.deployDescriptors(HostConfig.java:= 483) at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:427) at org.apache.catalina.startup.HostConfig.start(HostConfig.java:983) at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:349= ) at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSup= port.java:119) at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1091) at org.apache.catalina.core.StandardHost.start(StandardHost.java:789) at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1083) at org.apache.catalina.core.StandardEngine.start(StandardEngine.java:478) at org.apache.catalina.core.StandardService.start(StandardService.java:480) at org.apache.catalina.core.StandardServer.start(StandardServer.java:2313) at org.apache.catalina.startup.Catalina.start(Catalina.java:556) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java= :39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI= mpl.java:25) at java.lang.reflect.Method.invoke(Method.java:324) at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:287) at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:425) [ WARN] 20060803 08:24:01 (org.apache.jackrabbit.core.query.LazyReader) - exception initializing reader org.apache.jackrabbit.core.query.MsWordTextFilter$1: java.io.IOException: Invalid header signature; read 8656037701166316554, expected -2226271756974174256 Then there are a lot of nullpointer exceptions [DEBUG] 20060803 08:37:17 (org.apache.jackrabbit.core.ItemManager) - removing item 8637bf5f-4689-4e75-888f-b7b89bef40c8 from cache [ WARN] 20060803 08:40:13 (org.apache.jackrabbit.core.RepositoryImpl) - Existing lock file at C:\Wave\Repository\.lock deteteced. Repository was not shut down properly. [ERROR] 20060803 09:33:14 (org.apache.jackrabbit.core.observation.ObservationManagerFactory) - Synchronous EventConsumer threw exception. java.lang.NullPointerException: null values not allowed at org.apache.commons.collections.map.AbstractReferenceMap.put(AbstractRefer= enceMap.java:251) at org.apache.jackrabbit.core.version.VersionManagerImpl.getItem(VersionMana= gerImpl.java:242) at org.apache.jackrabbit.core.version.AbstractVersionManager.getVersion(Abst= ractVersionManager.java:62) at org.apache.jackrabbit.core.version.VersionItemStateProvider.getItemState(= VersionItemStateProvider.java:131) at org.apache.jackrabbit.core.state.SharedItemStateManager.getItemState(Shar= edItemStateManager.java:212) at org.apache.jackrabbit.core.state.LocalItemStateManager.getPropertyState(L= ocalItemStateManager.java:111) at org.apache.jackrabbit.core.state.LocalItemStateManager.getItemState(Local= ItemStateManager.java:143) at org.apache.jackrabbit.core.state.SessionItemStateManager.getItemState(Ses= sionItemStateManager.java:127) at org.apache.jackrabbit.core.query.lucene.NodeIndexer.createDoc(NodeIndexer= .java:155) at org.apache.jackrabbit.core.query.lucene.NodeIndexer.createDocument(NodeIn= dexer.java:112) at org.apache.jackrabbit.core.query.lucene.SearchIndex.createDocument(Search= Index.java:449) at org.apache.jackrabbit.core.query.lucene.SearchIndex $2.next(SearchIndex.java:292) at org.apache.jackrabbit.core.query.lucene.MultiIndex.update(MultiIndex.java= :313) at org.apache.jackrabbit.core.query.lucene.SearchIndex.updateNodes(SearchInd= ex.java:279) at org.apache.jackrabbit.core.SearchManager.onEvent(SearchManager.java:476) at org.apache.jackrabbit.core.observation.EventConsumer.consumeEvents(EventC= onsumer.java:230) at org.apache.jackrabbit.core.observation.ObservationManagerFactory.dispatch= Events(ObservationManagerFactory.java:218) at org.apache.jackrabbit.core.observation.EventStateCollection.dispatch(Even= tStateCollection.java:430) at org.apache.jackrabbit.core.observation.DelegatingObservationDispatcher.di= spatch(DelegatingObservationDispatcher.java:105) at org.apache.jackrabbit.core.observation.DelegatingObservationDispatcher.di= spatchEvents(DelegatingObservationDispatcher.java:87) at org.apache.jackrabbit.core.observation.EventStateCollection.dispatch(Even= tStateCollection.java:430) at org.apache.jackrabbit.core.state.SharedItemStateManager $Update.end(SharedItemStateManager.java:607) at org.apache.jackrabbit.core.state.XAItemStateManager.commit(XAItemStateMan= ager.java:170) at org.apache.jackrabbit.core.version.XAVersionManager.commit(XAVersionManag= er.java:440) at org.apache.jackrabbit.core.TransactionContext.commit(TransactionContext.j= ava:172) at org.apache.jackrabbit.core.XASessionImpl.commit(XASessionImpl.java:324) at it.wavegroup.imco.jackrabbit.transaction.UserTransactionImpl.commit(Unkno= wn Source) at it.wavegroup.imco.services.SessionFacade.commitJackrabbitTransaction(Unkn= own Source) at it.wavegroup.imco.services.RepositoryService.removeNode(Unknown Source) at it.wavegroup.imco.actions.FilesAction.delete(Unknown Source) at it.wavegroup.imco.actions.BaseAction.selectForward(Unknown Source) at it.wavegroup.imco.actions.FilesAction.selectForward(Unknown Source) at it.wavegroup.imco.actions.BaseAction.execute(Unknown Source) at org.apache.struts.action.RequestProcessor.processActionPerform(RequestPro= cessor.java:421) at org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:2= 26) at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1164) at org.apache.struts.action.ActionServlet.doGet(ActionServlet.java:397) at javax.servlet.http.HttpServlet.service(HttpServlet.java:689) at javax.servlet.http.HttpServlet.service(HttpServlet.java:802) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applicat= ionFilterChain.java:237) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilte= rChain.java:157) at it.wavegroup.imco.servlets.AuthenticationFilter.doFilter(Unknown Source) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applicat= ionFilterChain.java:186) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilte= rChain.java:157) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve= .java:214) at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveCon= text.java:104) at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:52= 0) at org.apache.catalina.core.StandardContextValve.invokeInternal(StandardCont= extValve.java:198) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve= .java:152) at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveCon= text.java:104) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorB= ase.java:540) at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveCon= text.java:102) at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:52= 0) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:= 137) at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveCon= text.java:104) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:= 118) at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveCon= text.java:102) at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:52= 0) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.j= ava:109) at org.apache.catalina.core.StandardValveContext.invokeNext(StandardValveCon= text.java:104) at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:52= 0) at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:929) at org.apache.coyote.tomcat5.CoyoteAdapter.service(CoyoteAdapter.java:160) at org.apache.jk.server.JkCoyoteHandler.invoke(JkCoyoteHandler.java:300) at org.apache.jk.common.HandlerRequest.invoke(HandlerRequest.java:374) at org.apache.jk.common.ChannelSocket.invoke(ChannelSocket.java:743) at org.apache.jk.common.ChannelSocket.processConnection(ChannelSocket.java:6= 75) at org.apache.jk.common.SocketConnection.runIt(ChannelSocket.java:866) at org.apache.tomcat.util.threads.ThreadPool $ControlRunnable.run(ThreadPool.java:683) at java.lang.Thread.run(Thread.java:534) and last there are the outofMemory errors [ERROR] 20060825 11:27:53 (org.apache.jackrabbit.core.observation.ObservationManagerFactory) - Synchronous EventConsumer threw exception. java.lang.OutOfMemoryError ... [ERROR] 20060825 18:04:21 (org.apache.jackrabbit.core.observation.ObservationManagerFactory) - Synchronous EventConsumer threw exception. java.lang.OutOfMemoryError [ WARN] 20060826 00:39:03 (org.apache.jackrabbit.core.RepositoryImpl) - Existing lock file at C:\Wave\Repository\.lock deteteced. Repository was not shut down properly. All there errors happened a lot of times (a lot means 10, 20 times each one), but I can't understand if all these causes the Out of Memory. Maybe after the exception resources are never free, so after a while the system exaust the memory, but also the number of errors is not so high (in my opinion). I think there is something else (maybe something similar with the sessions between jackrabbit 0.9 and 1.0). > Jukka Zitting chris >=20