Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 1F284200B6B for ; Thu, 25 Aug 2016 18:09:12 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 1DBF3160AA5; Thu, 25 Aug 2016 16:09:12 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 657DA160AA4 for ; Thu, 25 Aug 2016 18:09:11 +0200 (CEST) Received: (qmail 61036 invoked by uid 500); 25 Aug 2016 16:09:10 -0000 Mailing-List: contact users-help@activemq.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@activemq.apache.org Delivered-To: mailing list users@activemq.apache.org Received: (qmail 61017 invoked by uid 99); 25 Aug 2016 16:09:09 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 25 Aug 2016 16:09:09 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 587641818E7 for ; Thu, 25 Aug 2016 16:09:09 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.556 X-Spam-Level: ** X-Spam-Status: No, score=2.556 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, URI_HEX=1.313, URI_TRY_3LD=0.064] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id ov5NDGpbKKHv for ; Thu, 25 Aug 2016 16:09:06 +0000 (UTC) Received: from mail-yb0-f180.google.com (mail-yb0-f180.google.com [209.85.213.180]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 8222460D7C for ; Thu, 25 Aug 2016 16:09:05 +0000 (UTC) Received: by mail-yb0-f180.google.com with SMTP id d10so18047282ybi.1 for ; Thu, 25 Aug 2016 09:09:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=DwBQiI8uc4vvy1/NX3VOCQTj/tpjkG3HzPSJzJKuDoc=; b=a3rRDPr05XViVI94iXiwp/MbfjWCyfdI05uVBSGqZqUI3S7N3jcP4Ss21CLyOvyGCM vgrajkhzs52T03NEiZHSOBAuz888+jiuV5l6QR0LuLZgAPECq6BGcsUwn0D3bkkoVX+M E0UIqrA8LcJGiPRjty/v1+qBNGVPw8oNvS8WOaGArN6M0ydFRwGKQl06EOwmoJWT6wFS gZSijDIBEXryGUkoWmLpoUuouXjpAAf521k2ViOYwjv7RC8D79AAU9cU9FZMcMAwtjW9 uFRNaqKKFmjyS+0yJE2UR0okA9s1PAkZJpkHq9/YhPWcTKMdAa00QJGG0YIUgtXN+yGx N9NA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=DwBQiI8uc4vvy1/NX3VOCQTj/tpjkG3HzPSJzJKuDoc=; b=JCOH+G65c9cNCLU8GxmcFbeYsmmmrs4lHPXzmBxyegtyViUtEO8Oq/z6lWmLL9y3fD eOybwZN3hICLtIabk0s55Xm55Vg/FjN4+Kxp7KopZanoegdxeTwAU5NFQNXMxJbBM0zu aHDgP1tRHa6wG2fpjI6hFAWMA+iwlA49ogyhYr3hrJ3xyxFVdDMFcY4ezBSuN48dbdGb Pllr42o5GMRYB+0r6fLexbGRmnjncGMbev08AMPURUqhbEMrG/MvlKQ3yHSVQFbcCsCX KPKfDhrOmYw7kHhBMgaiJehAl2VEgQRszUIDVGypgZ25FWz3h/ztau3gwGpR3/31f6oY YhHg== X-Gm-Message-State: AEkoous+/RMJQIVHjdwunIclYAL8vqFFR6WmyUfz6RkritdTKsNI4Tsnf7vZ2LMvif6JNGIOfyRcXejAlKxH7w== X-Received: by 10.37.30.70 with SMTP id e67mr7071332ybe.94.1472141337883; Thu, 25 Aug 2016 09:08:57 -0700 (PDT) MIME-Version: 1.0 Received: by 10.37.82.213 with HTTP; Thu, 25 Aug 2016 09:08:27 -0700 (PDT) In-Reply-To: <1472057913407-4715794.post@n4.nabble.com> References: <1472057913407-4715794.post@n4.nabble.com> From: Christopher Shannon Date: Thu, 25 Aug 2016 12:08:27 -0400 Message-ID: Subject: Re: [ActiveMQ 5.11.1] Question around WireFormat byte array size To: users@activemq.apache.org Content-Type: multipart/alternative; boundary=001a1143f52c80fa74053ae79d91 archived-at: Thu, 25 Aug 2016 16:09:12 -0000 --001a1143f52c80fa74053ae79d91 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable What happens if you turn off caching for the wireFormat by setting wireFormat.cacheEnabled=3Dfalse ? On Wed, Aug 24, 2016 at 12:58 PM, mmacpherson wrote: > Hello, > > This was posted as a sub question to a thread in the Dev forum, but as I = am > really struggling to understand where this setting is coming from I thoug= ht > I would ask on the more general User group. Maybe someone has run into th= is > =3D) > > Other form thread subject (MaxFrameSize not honored and allowing 64MB > messages to go through) > > Basic info, ActiveMQ 5.11 .1 (we have plans to test with 5.14), and we ar= e > getting some odd results while a node becomes the active broker. > > at > org.apache.activemq.openwire.v10.BaseDataStreamMarshaller. > tightUnmarshalByteSequence > at org.apache.activemq.openwire.v10.WireFormatInfoMarshaller. > tightUnmarshal > at org.apache.activemq.openwire.OpenWireFormat.doUnmarshal > at org.apache.activemq.openwire.OpenWireFormat.unmarshal > > The core issue for us appears to be the byte stream is getting parsed wit= h > tightEncodingEnabled set to TRUE, but the stream itself is not actually > formatted in this manner. This takes things on a unexpected path. > > My concern is that if we address this, simply but setting > tightEncodingEnabled to false, I still see some issues with the Byte > stream. > > The Size value being provided before the ActiveMQ Magic bytes and the > Datatype parameter appears to be a negative value. > > byte|[21] |0 > byte|[22] |0 > byte|[23] |0 > byte|[24] |-16 > > byte|[25] |1 > byte|[26] |65 ->A > byte|[27] |99 ->c > byte|[28] |116 ->t > byte|[29] |105 ->i > byte|[30] |118 ->v > byte|[31] |101 ->e > byte|[32] |77 ->M > byte|[33] |81 ->Q > > And then after this, if its parsed correctly, after the Magic bytes and > then > the Version bytes, the next section is used to control the size of a Byte= [] > that=E2=80=99s created. When you do the shifting that size should turn ou= t to be > 16777216: > > ActiveMQ magic: > byte|[26] |65 ->A > byte|[27] |99 ->c > byte|[28] |116 ->t > byte|[29] |105 ->i > byte|[30] |118 ->v > byte|[31] |101 ->e > byte|[32] |77 ->M > byte|[33] |81 ->Q > Version (10) > byte|[34] |0 > byte|[35] |0 > byte|[36] |0 > byte|[37] |10 > Byte array size (16777216) > byte|[38] |1 > byte|[39] |0 > byte|[40] |0 > byte|[41] |0 > > Is anyone aware of a setting we are missing? We use the > ActiveMQSslConnectionFactory and pass the following params in currently: > > initialReconnectDelay=3D10 > maxReconnectDelay=3D30000 > maxReconnectAttempts=3D10 > startupMaxReconnectAttempts=3D1 > timeout=3D60000 > randomize=3Dfalse > useExponentialBackOff=3Dtrue > priorityBackup=3Dtrue > jms.useAsyncSend=3Dtrue > nested.soTimeout=3D60000 > nested.soWriteTimeout=3D60000 > nested.wireFormat.maxFrameSize=3D262144 > > Matt > > > > > -- > View this message in context: http://activemq.2283324.n4. > nabble.com/ActiveMQ-5-11-1-Question-around-WireFormat- > byte-array-size-tp4715794.html > Sent from the ActiveMQ - User mailing list archive at Nabble.com. > --001a1143f52c80fa74053ae79d91--