Mailing-List: contact dev-help@asterixdb.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@asterixdb.incubator.apache.org
Content-Type: multipart/alternative;
 boundary="Apple-Mail=_9553CB7E-EA19-4E08-8351-43BA8021BA1F"
Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2102\))
Subject: Re: Issue 933 in asterixdb: IllegalStateException in startRecovery
From: Murtadha Hubail <hubailmor@gmail.com>
In-Reply-To: 
 <4-5165316186810778062-18096082880708760374-asterixdb=googlecode.com@googlecode.com>
Date: Thu, 13 Aug 2015 11:36:17 +0300
Cc: dev@asterixdb.incubator.apache.org
Message-Id: <258C7040-5E81-4753-9EF7-12A2E245E893@gmail.com>
References: 
 <3-5165316186810778062-18096082880708760374-asterixdb=googlecode.com@googlecode.com>
 <0-5165316186810778062-18096082880708760374-asterixdb=googlecode.com@googlecode.com>
 <4-5165316186810778062-18096082880708760374-asterixdb=googlecode.com@googlecode.com>
To: asterixdb@googlecode.com

--Apple-Mail=_9553CB7E-EA19-4E08-8351-43BA8021BA1F
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=us-ascii

@Yingyi,

Both of these issues are related to corrupted log records.

The problem was reported in issue902:
=
https://code.google.com/p/asterixdb/issues/detail?id=3D902&q=3Dlogs&colspe=
c=3DID%20Type%20Status%20Priority%20Milestone%20Owner%20Summary%20ETA%20Se=
verity =
<https://code.google.com/p/asterixdb/issues/detail?id=3D902&q=3Dlogs&colsp=
ec=3DID%20Type%20Status%20Priority%20Milestone%20Owner%20Summary%20ETA%20S=
everity>

Ian has already started a fix for this.

P.S. for the unusable cluster issue, looks like we need data replication =
support to overcome the problem :-)

> On Aug 13, 2015, at 5:56 AM, asterixdb@googlecode.com wrote:
>=20
>=20
> Comment #4 on issue 933 by buyingyi: IllegalStateException in =
startRecovery
> https://code.google.com/p/asterixdb/issues/detail?id=3D933
>=20
> Got a similar issue -- my entire cluster is unusable now because one =
NC cannot start well:
>=20
> Aug 12, 2015 7:46:33 PM edu.uci.ics.hyracks.control.nc.NCDriver main
> SEVERE: Setting uncaught exception handler =
edu.uci.ics.hyracks.api.lifecycle.LifeCycleComponentManager@c81739c
> Aug 12, 2015 7:46:33 PM =
edu.uci.ics.hyracks.control.nc.NodeControllerService start
> INFO: Starting NodeControllerService
> Aug 12, 2015 7:46:33 PM =
edu.uci.ics.asterix.hyracks.bootstrap.NCApplicationEntryPoint start
> INFO: Starting Asterix node controller: test_sensorium-27
> java.lang.IllegalStateException: Failed to redo
> 	at =
edu.uci.ics.asterix.transaction.management.service.recovery.RecoveryManage=
r.redo(RecoveryManager.java:738)
> 	at =
edu.uci.ics.asterix.transaction.management.service.recovery.RecoveryManage=
r.startRecovery(RecoveryManager.java:318)
> 	at =
edu.uci.ics.asterix.hyracks.bootstrap.NCApplicationEntryPoint.start(NCAppl=
icationEntryPoint.java:118)
> 	at =
edu.uci.ics.hyracks.control.nc.NodeControllerService.startApplication(Node=
ControllerService.java:318)
> 	at =
edu.uci.ics.hyracks.control.nc.NodeControllerService.start(NodeControllerS=
ervice.java:255)
> 	at =
edu.uci.ics.hyracks.control.nc.NCDriver.main(NCDriver.java:44)
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
> 	at =
edu.uci.ics.hyracks.storage.am.common.tuples.TypeAwareTupleWriter.getField=
SlotsBytes(TypeAwareTupleWriter.java:122)
> 	at =
edu.uci.ics.hyracks.storage.am.common.tuples.TypeAwareTupleWriter.bytesReq=
uired(TypeAwareTupleWriter.java:36)
> 	at =
edu.uci.ics.hyracks.storage.am.lsm.btree.tuples.LSMBTreeTupleWriter.bytesR=
equired(LSMBTreeTupleWriter.java:39)
> 	at =
edu.uci.ics.hyracks.storage.am.btree.frames.BTreeNSMInteriorFrame.getBytes=
RequriedToWriteTuple(BTreeNSMInteriorFrame.java:59)
> 	at =
edu.uci.ics.hyracks.storage.am.btree.impls.BTree.upsert(BTree.java:327)
> 	at =
edu.uci.ics.hyracks.storage.am.btree.impls.BTree.access$500(BTree.java:70)=

> 	at =
edu.uci.ics.hyracks.storage.am.btree.impls.BTree$BTreeAccessor.upsertIfCon=
ditionElseInsert(BTree.java:897)
> 	at =
edu.uci.ics.hyracks.storage.am.btree.impls.BTree$BTreeAccessor.upsert(BTre=
e.java:890)
> 	at =
edu.uci.ics.hyracks.storage.am.lsm.btree.impls.LSMBTree.modify(LSMBTree.ja=
va:365)
> 	at =
edu.uci.ics.hyracks.storage.am.lsm.common.impls.LSMHarness.modify(LSMHarne=
ss.java:331)
> 	at =
edu.uci.ics.hyracks.storage.am.lsm.common.impls.LSMHarness.forceModify(LSM=
Harness.java:314)
> 	at =
edu.uci.ics.hyracks.storage.am.lsm.common.impls.LSMTreeIndexAccessor.force=
Delete(LSMTreeIndexAccessor.java:159)
> 	at =
edu.uci.ics.asterix.transaction.management.service.recovery.RecoveryManage=
r.redo(RecoveryManager.java:733)
> 	... 5 more
>=20
> --=20
> You received this message because you were CC'd on the issue.
> You may adjust your notification preferences at:
> https://code.google.com/hosting/settings
>=20
> Reply to this email to add a comment or make updates.


--Apple-Mail=_9553CB7E-EA19-4E08-8351-43BA8021BA1F--