Mailing-List: contact users-help@activemq.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@activemq.apache.org
Received-SPF: pass (athena.apache.org: domain of chirino@gmail.com designates
 209.85.212.50 as permitted sender)
MIME-Version: 1.0
Sender: chirino@gmail.com
In-Reply-To: <3C05E861-4DEB-438C-976B-FCEB29824F33@cfandersen.com>
References: <1369578103634-4667495.post@n4.nabble.com>
	<CAKS7T5OytC1LxZkL1VGOfm6Mm7grCSLvJZG9eYX_-Z9YZvr9rw@mail.gmail.com>
	<1369712834158-4667522.post@n4.nabble.com>
	<1369763262357-4667560.post@n4.nabble.com>
	<CAGZ-RD+qRqPm4-vWHijFuU6ZxhsJengfubgcROYYOp2t+FFAdA@mail.gmail.com>
	<3C05E861-4DEB-438C-976B-FCEB29824F33@cfandersen.com>
Date: Mon, 3 Jun 2013 11:54:16 -0400
Message-ID: 
 <CAGZ-RDJrAwaBnUytg8Ptp+2Fn=ov4YFbUbh5g+ERf1voyygwuA@mail.gmail.com>
Subject: Re: Activemq 5.9 leveldb replication issue
From: Hiram Chirino <hiram@hiramchirino.com>
To: users <users@activemq.apache.org>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hi Freddy,

That 'short record at position' is odd.  Basically it means it tired
to read a message from the log file and the read call read fewer bytes
than what we requested.  I guess that's valid for an OS to do and we
just need to issue an additional read to load the remaining bytes.
I've just committed a change that should help with that:
http://is.gd/0nMmLH

So try out a new snapshot and keep an eye for that exception and let
me know you see it happen on your system again.

Thanks!


On Fri, May 31, 2013 at 1:28 PM, heimdull <freddy@cfandersen.com> wrote:
> I tried this morning to replicate the issue on these two servers and was =
not able to do so. The only issue that I got was a few messages that got st=
uck in the queue with a consumer holding them hostage. either restarting th=
at consumer or moving them to a different queue and back resolved that.
>
> I did look at older errors that I had and found there recovery mode error=
s:
>
> INFO   | jvm 1    | 2013/05/19 12:15:22 |  INFO | DB recovered from failu=
re.
> INFO   | jvm 1    | 2013/05/19 12:15:22 |  WARN | DB operation failed. (e=
ntering recovery mode)
> INFO   | jvm 1    | 2013/05/19 12:15:22 | java.io.IOException: short reco=
rd at position: 2467052 in file: /opt/activemq/data/0000000000000000.log, o=
ffset: 2467052
> INFO   | jvm 1    | 2013/05/19 12:15:22 |       at org.apache.activemq.le=
veldb.RecordLog$LogReader.read(RecordLog.scala:287)


--
Hiram Chirino

Engineering | Red Hat, Inc.

hchirino@redhat.com | fusesource.com | redhat.com

skype: hiramchirino | twitter: @hiramchirino

blog: Hiram Chirino's Bit Mojo