Return-Path: Delivered-To: apmail-activemq-dev-archive@www.apache.org Received: (qmail 89957 invoked from network); 21 Sep 2010 16:26:04 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 21 Sep 2010 16:26:04 -0000 Received: (qmail 92028 invoked by uid 500); 21 Sep 2010 16:26:03 -0000 Delivered-To: apmail-activemq-dev-archive@activemq.apache.org Received: (qmail 91988 invoked by uid 500); 21 Sep 2010 16:26:03 -0000 Mailing-List: contact dev-help@activemq.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@activemq.apache.org Delivered-To: mailing list dev@activemq.apache.org Received: (qmail 91980 invoked by uid 99); 21 Sep 2010 16:26:02 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Sep 2010 16:26:02 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Sep 2010 16:26:01 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id o8LGPfwN017976 for ; Tue, 21 Sep 2010 16:25:41 GMT Message-ID: <11491249.26781285086341045.JavaMail.jira@thor> Date: Tue, 21 Sep 2010 12:25:41 -0400 (EDT) From: "Andy (JIRA)" To: dev@activemq.apache.org Subject: [jira] Commented: (AMQ-2268) ActiveMQ fails to recover after deleting kr-store/state/index-store-state In-Reply-To: <1252529158.1243412630582.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: ae95407df07c98740808b2ef9da0087c [ https://issues.apache.org/activemq/browse/AMQ-2268?page=3Dcom.atlassi= an.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D61= 974#action_61974 ]=20 Andy commented on AMQ-2268: --------------------------- I am seeing this in the current trunk 'very' often, usually after a an uncl= ean shutdown but also on a clean shutdown. ERROR - Failed to start ActiveMQ JMS Message Broker. Reason: java.io.EOFExc= eption: Chunk stream does not exist at page: 0 java.io.EOFException: Chunk stream does not exist at page: 0 =09at org.apache.kahadb.page.Transaction$2.readPage(Transaction.java:454) =09at org.apache.kahadb.page.Transaction$2.(Transaction.java:431) =09at org.apache.kahadb.page.Transaction.openInputStream(Transaction.java:4= 28) =09at org.apache.kahadb.page.Transaction.load(Transaction.java:404) =09at org.apache.kahadb.page.Transaction.load(Transaction.java:361) =09at org.apache.activemq.broker.scheduler.JobSchedulerStore$3.execute(JobS= chedulerStore.java:250) =09at org.apache.kahadb.page.Transaction.execute(Transaction.java:728) =09at org.apache.activemq.broker.scheduler.JobSchedulerStore.doStart(JobSch= edulerStore.java:239) =09at org.apache.activemq.util.ServiceSupport.start(ServiceSupport.java:53) =09at org.apache.activemq.broker.scheduler.SchedulerBroker.getStore(Schedul= erBroker.java:198) =09at org.apache.activemq.broker.scheduler.SchedulerBroker.getInternalSched= uler(SchedulerBroker.java:185) =09at org.apache.activemq.broker.scheduler.SchedulerBroker.start(SchedulerB= roker.java:85) =09at org.apache.activemq.broker.BrokerFilter.start(BrokerFilter.java:157) =09at org.apache.activemq.broker.BrokerFilter.start(BrokerFilter.java:157) =09at org.apache.activemq.broker.TransactionBroker.start(TransactionBroker.= java:112) =09at org.apache.activemq.broker.BrokerService$3.start(BrokerService.java:1= 786) =09at org.apache.activemq.broker.BrokerService.start(BrokerService.java:496= ) =09at org.apache.activemq.ra.ActiveMQResourceAdapter$1.run(ActiveMQResource= Adapter.java:85) Is it related I wonder? Deleting store files by hand (and now currently wri= tten into code as a temp workaround) is the only way to get ActiveMQ to fir= e up. > ActiveMQ fails to recover after deleting kr-store/state/index-store-state > ------------------------------------------------------------------------- > > Key: AMQ-2268 > URL: https://issues.apache.org/activemq/browse/AMQ-2268 > Project: ActiveMQ > Issue Type: Bug > Affects Versions: 5.2.0 > Environment: Ubuntu 8.10 Server 64 Bit, Java 6 > Reporter: J=C3=B6rn Kottmann > > The documentation says: > "... It is possbile to force automatic recovery if using the Kaha referen= ce store (the default) by deleting the kr-store/state/index-store-state fil= e." > (http://activemq.apache.org/amq-message-store.html). > After deleting the index-store-state file ActiveMQ fails to start again w= ith these errors: > 2009-05-26 16:10:07,294 [main ] INFO DefaultCamelContext = - JMX enabled. Using InstrumentationLifecycleStrategy. > 2009-05-26 16:10:07,409 [main ] INFO BrokerService = - Using Persistence Adapter: AMQPersistenceAdapter(/usr/local/apache-= activemq-5.2.0/data) > 2009-05-26 16:10:07,415 [main ] INFO AMQPersistenceAdapter = - AMQStore starting using directory: /usr/local/apache-activemq-5.2.0= /data > 2009-05-26 16:10:07,439 [main ] INFO KahaStore = - Kaha Store using data directory /usr/local/apache-activemq-5.2.0/da= ta/kr-store/state > 2009-05-26 16:10:07,453 [main ] ERROR BrokerService = - Failed to start ActiveMQ JMS Message Broker. Reason: java.io.EOFExc= eption > java.io.EOFException > =09at java.io.RandomAccessFile.readFully(RandomAccessFile.java:383) > =09at java.io.RandomAccessFile.readFully(RandomAccessFile.java:361) > =09at org.apache.activemq.kaha.impl.index.StoreIndexReader.readItem(Store= IndexReader.java:46) > =09at org.apache.activemq.kaha.impl.index.IndexManager.getIndex(IndexMana= ger.java:70) > =09at org.apache.activemq.kaha.impl.IndexRootContainer.getRoot(IndexRootC= ontainer.java:126) > =09at org.apache.activemq.kaha.impl.KahaStore.generateInterestInMapDataFi= les(KahaStore.java:576) > =09at org.apache.activemq.kaha.impl.KahaStore.initialize(KahaStore.java:4= 98) > =09at org.apache.activemq.kaha.impl.KahaStore.getMapContainerIds(KahaStor= e.java:256) > =09at org.apache.activemq.store.kahadaptor.KahaReferenceStoreAdapter.star= t(KahaReferenceStoreAdapter.java:94) > =09at org.apache.activemq.store.amq.AMQPersistenceAdapter.start(AMQPersis= tenceAdapter.java:231) > =09at org.apache.activemq.broker.BrokerService.start(BrokerService.java:4= 58) > =09at org.apache.activemq.xbean.XBeanBrokerService.afterPropertiesSet(XBe= anBrokerService.java:52) > =09at org.springframework.beans.factory.support.AbstractAutowireCapableBe= anFactory.invokeInitMethods(AbstractAutowireCapableBeanFactory.java:1368) > =09at org.springframework.beans.factory.support.AbstractAutowireCapableBe= anFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1334) > =09at org.springframework.beans.factory.support.AbstractAutowireCapableBe= anFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:473) > =09at org.springframework.beans.factory.support.AbstractAutowireCapableBe= anFactory$1.run(AbstractAutowireCapableBeanFactory.java:409) > =09at java.security.AccessController.doPrivileged(Native Method) > =09at org.springframework.beans.factory.support.AbstractAutowireCapableBe= anFactory.createBean(AbstractAutowireCapableBeanFactory.java:380) > =09at org.springframework.beans.factory.support.AbstractBeanFactory$1.get= Object(AbstractBeanFactory.java:264) > =09at org.springframework.beans.factory.support.DefaultSingletonBeanRegis= try.getSingleton(DefaultSingletonBeanRegistry.java:221) > =09at org.springframework.beans.factory.support.AbstractBeanFactory.doGet= Bean(AbstractBeanFactory.java:261) > =09at org.springframework.beans.factory.support.AbstractBeanFactory.getBe= an(AbstractBeanFactory.java:185) > =09at org.springframework.beans.factory.support.AbstractBeanFactory.getBe= an(AbstractBeanFactory.java:164) > =09at org.springframework.beans.factory.support.DefaultListableBeanFactor= y.preInstantiateSingletons(DefaultListableBeanFactory.java:429) > =09at org.springframework.context.support.AbstractApplicationContext.fini= shBeanFactoryInitialization(AbstractApplicationContext.java:729) > =09at org.springframework.context.support.AbstractApplicationContext.refr= esh(AbstractApplicationContext.java:381) > =09at org.apache.xbean.spring.context.ResourceXmlApplicationContext.(ResourceXmlApplicationContext.java:64) > =09at org.apache.xbean.spring.context.ResourceXmlApplicationContext.(ResourceXmlApplicationContext.java:52) > =09at org.apache.activemq.xbean.XBeanBrokerFactory.createApplicationConte= xt(XBeanBrokerFactory.java:96) > =09at org.apache.activemq.xbean.XBeanBrokerFactory.createBroker(XBeanBrok= erFactory.java:52) > =09at org.apache.activemq.broker.BrokerFactory.createBroker(BrokerFactory= .java:71) > =09at org.apache.activemq.broker.BrokerFactory.createBroker(BrokerFactory= .java:54) > =09at org.apache.activemq.console.command.StartCommand.startBroker(StartC= ommand.java:115) > =09at org.apache.activemq.console.command.StartCommand.runTask(StartComma= nd.java:74) > =09at org.apache.activemq.console.command.AbstractCommand.execute(Abstrac= tCommand.java:57) > =09at org.apache.activemq.console.command.ShellCommand.runTask(ShellComma= nd.java:129) > =09at org.apache.activemq.console.command.AbstractCommand.execute(Abstrac= tCommand.java:57) > =09at org.apache.activemq.console.command.ShellCommand.main(ShellCommand.= java:79) > =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImp= l.java:39) > =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcc= essorImpl.java:25) > =09at java.lang.reflect.Method.invoke(Method.java:597) > =09at org.apache.activemq.console.Main.runTaskClass(Main.java:225) > =09at org.apache.activemq.console.Main.main(Main.java:106) > 2009-05-26 16:10:07,455 [main ] INFO BrokerService = - ActiveMQ Message Broker (dkcphlinh1master, null) is shutting down > 2009-05-26 16:10:07,455 [main ] INFO NetworkConnector = - Network Connector default-nc Stopped > 2009-05-26 16:10:07,456 [main ] INFO TransportConnector = - Connector openwire Stopped > 2009-05-26 16:10:07,456 [main ] INFO TransportConnector = - Connector ssl Stopped > 2009-05-26 16:10:07,456 [main ] INFO TransportConnector = - Connector stomp Stopped > 2009-05-26 16:10:07,456 [main ] INFO TransportConnector = - Connector xmpp Stopped > 2009-05-26 16:10:07,461 [main ] ERROR AMQPersistenceAdapter = - Could not stop service: AMQPersistenceAdapter(/usr/local/apache-act= ivemq-5.2.0/data). Reason: java.lang.NullPointerException > java.lang.NullPointerException > =09at org.apache.activemq.store.amq.AMQPersistenceAdapter.checkpoint(AMQP= ersistenceAdapter.java:351) > =09at org.apache.activemq.store.amq.AMQPersistenceAdapter.stop(AMQPersist= enceAdapter.java:318) > =09at org.apache.activemq.util.ServiceStopper.stop(ServiceStopper.java:41= ) > =09at org.apache.activemq.broker.BrokerService.stop(BrokerService.java:51= 9) > =09at org.apache.activemq.broker.BrokerService.start(BrokerService.java:4= 93) > =09at org.apache.activemq.xbean.XBeanBrokerService.afterPropertiesSet(XBe= anBrokerService.java:52) > =09at org.springframework.beans.factory.support.AbstractAutowireCapableBe= anFactory.invokeInitMethods(AbstractAutowireCapableBeanFactory.java:1368) > =09at org.springframework.beans.factory.support.AbstractAutowireCapableBe= anFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1334) > =09at org.springframework.beans.factory.support.AbstractAutowireCapableBe= anFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:473) > =09at org.springframework.beans.factory.support.AbstractAutowireCapableBe= anFactory$1.run(AbstractAutowireCapableBeanFactory.java:409) > =09at java.security.AccessController.doPrivileged(Native Method) > =09at org.springframework.beans.factory.support.AbstractAutowireCapableBe= anFactory.createBean(AbstractAutowireCapableBeanFactory.java:380) > =09at org.springframework.beans.factory.support.AbstractBeanFactory$1.get= Object(AbstractBeanFactory.java:264) > =09at org.springframework.beans.factory.support.DefaultSingletonBeanRegis= try.getSingleton(DefaultSingletonBeanRegistry.java:221) > =09at org.springframework.beans.factory.support.AbstractBeanFactory.doGet= Bean(AbstractBeanFactory.java:261) > =09at org.springframework.beans.factory.support.AbstractBeanFactory.getBe= an(AbstractBeanFactory.java:185) > =09at org.springframework.beans.factory.support.AbstractBeanFactory.getBe= an(AbstractBeanFactory.java:164) > =09at org.springframework.beans.factory.support.DefaultListableBeanFactor= y.preInstantiateSingletons(DefaultListableBeanFactory.java:429) > =09at org.springframework.context.support.AbstractApplicationContext.fini= shBeanFactoryInitialization(AbstractApplicationContext.java:729) > =09at org.springframework.context.support.AbstractApplicationContext.refr= esh(AbstractApplicationContext.java:381) > =09at org.apache.xbean.spring.context.ResourceXmlApplicationContext.(ResourceXmlApplicationContext.java:64) > =09at org.apache.xbean.spring.context.ResourceXmlApplicationContext.(ResourceXmlApplicationContext.java:52) > =09at org.apache.activemq.xbean.XBeanBrokerFactory.createApplicationConte= xt(XBeanBrokerFactory.java:96) > =09at org.apache.activemq.xbean.XBeanBrokerFactory.createBroker(XBeanBrok= erFactory.java:52) > =09at org.apache.activemq.broker.BrokerFactory.createBroker(BrokerFactory= .java:71) > =09at org.apache.activemq.broker.BrokerFactory.createBroker(BrokerFactory= .java:54) > =09at org.apache.activemq.console.command.StartCommand.startBroker(StartC= ommand.java:115) > =09at org.apache.activemq.console.command.StartCommand.runTask(StartComma= nd.java:74) > =09at org.apache.activemq.console.command.AbstractCommand.execute(Abstrac= tCommand.java:57) > =09at org.apache.activemq.console.command.ShellCommand.runTask(ShellComma= nd.java:129) > =09at org.apache.activemq.console.command.AbstractCommand.execute(Abstrac= tCommand.java:57) > =09at org.apache.activemq.console.command.ShellCommand.main(ShellCommand.= java:79) > =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImp= l.java:39) > =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcc= essorImpl.java:25) > =09at java.lang.reflect.Method.invoke(Method.java:597) > =09at org.apache.activemq.console.Main.runTaskClass(Main.java:225) > =09at org.apache.activemq.console.Main.main(Main.java:106) > 2009-05-26 16:10:07,462 [main ] INFO BrokerService = - ActiveMQ JMS Message Broker (dkcphlinh1master, null) stopped > 2009-05-26 16:10:07,462 [main ] WARN BrokerService = - Failed to stop broker after failure in start=20 > java.lang.NullPointerException > =09at org.apache.activemq.store.amq.AMQPersistenceAdapter.checkpoint(AMQP= ersistenceAdapter.java:351) > =09at org.apache.activemq.store.amq.AMQPersistenceAdapter.stop(AMQPersist= enceAdapter.java:318) > =09at org.apache.activemq.util.ServiceStopper.stop(ServiceStopper.java:41= ) > =09at org.apache.activemq.broker.BrokerService.stop(BrokerService.java:51= 9) > =09at org.apache.activemq.broker.BrokerService.start(BrokerService.java:4= 93) > =09at org.apache.activemq.xbean.XBeanBrokerService.afterPropertiesSet(XBe= anBrokerService.java:52) > =09at org.springframework.beans.factory.support.AbstractAutowireCapableBe= anFactory.invokeInitMethods(AbstractAutowireCapableBeanFactory.java:1368) > =09at org.springframework.beans.factory.support.AbstractAutowireCapableBe= anFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1334) > =09at org.springframework.beans.factory.support.AbstractAutowireCapableBe= anFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:473) > =09at org.springframework.beans.factory.support.AbstractAutowireCapableBe= anFactory$1.run(AbstractAutowireCapableBeanFactory.java:409) > =09at java.security.AccessController.doPrivileged(Native Method) > =09at org.springframework.beans.factory.support.AbstractAutowireCapableBe= anFactory.createBean(AbstractAutowireCapableBeanFactory.java:380) > =09at org.springframework.beans.factory.support.AbstractBeanFactory$1.get= Object(AbstractBeanFactory.java:264) > =09at org.springframework.beans.factory.support.DefaultSingletonBeanRegis= try.getSingleton(DefaultSingletonBeanRegistry.java:221) > =09at org.springframework.beans.factory.support.AbstractBeanFactory.doGet= Bean(AbstractBeanFactory.java:261) > =09at org.springframework.beans.factory.support.AbstractBeanFactory.getBe= an(AbstractBeanFactory.java:185) > =09at org.springframework.beans.factory.support.AbstractBeanFactory.getBe= an(AbstractBeanFactory.java:164) > =09at org.springframework.beans.factory.support.DefaultListableBeanFactor= y.preInstantiateSingletons(DefaultListableBeanFactory.java:429) > =09at org.springframework.context.support.AbstractApplicationContext.fini= shBeanFactoryInitialization(AbstractApplicationContext.java:729) > =09at org.springframework.context.support.AbstractApplicationContext.refr= esh(AbstractApplicationContext.java:381) > =09at org.apache.xbean.spring.context.ResourceXmlApplicationContext.(ResourceXmlApplicationContext.java:64) > =09at org.apache.xbean.spring.context.ResourceXmlApplicationContext.(ResourceXmlApplicationContext.java:52) > =09at org.apache.activemq.xbean.XBeanBrokerFactory.createApplicationConte= xt(XBeanBrokerFactory.java:96) > =09at org.apache.activemq.xbean.XBeanBrokerFactory.createBroker(XBeanBrok= erFactory.java:52) > =09at org.apache.activemq.broker.BrokerFactory.createBroker(BrokerFactory= .java:71) > =09at org.apache.activemq.broker.BrokerFactory.createBroker(BrokerFactory= .java:54) > =09at org.apache.activemq.console.command.StartCommand.startBroker(StartC= ommand.java:115) > =09at org.apache.activemq.console.command.StartCommand.runTask(StartComma= nd.java:74) > =09at org.apache.activemq.console.command.AbstractCommand.execute(Abstrac= tCommand.java:57) > =09at org.apache.activemq.console.command.ShellCommand.runTask(ShellComma= nd.java:129) > =09at org.apache.activemq.console.command.AbstractCommand.execute(Abstrac= tCommand.java:57) > =09at org.apache.activemq.console.command.ShellCommand.main(ShellCommand.= java:79) > =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImp= l.java:39) > =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcc= essorImpl.java:25) > =09at java.lang.reflect.Method.invoke(Method.java:597) > =09at org.apache.activemq.console.Main.runTaskClass(Main.java:225) > =09at org.apache.activemq.console.Main.main(Main.java:106) --=20 This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.