Return-Path: X-Original-To: apmail-activemq-users-archive@www.apache.org Delivered-To: apmail-activemq-users-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1F0A7DFB0 for ; Thu, 29 Nov 2012 23:17:38 +0000 (UTC) Received: (qmail 2263 invoked by uid 500); 29 Nov 2012 23:17:37 -0000 Delivered-To: apmail-activemq-users-archive@activemq.apache.org Received: (qmail 2202 invoked by uid 500); 29 Nov 2012 23:17:37 -0000 Mailing-List: contact users-help@activemq.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@activemq.apache.org Delivered-To: mailing list users@activemq.apache.org Received: (qmail 2181 invoked by uid 99); 29 Nov 2012 23:17:37 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 Nov 2012 23:17:37 +0000 X-ASF-Spam-Status: No, hits=2.8 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,URI_HEX X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of christian.posta@gmail.com designates 209.85.223.171 as permitted sender) Received: from [209.85.223.171] (HELO mail-ie0-f171.google.com) (209.85.223.171) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 Nov 2012 23:17:30 +0000 Received: by mail-ie0-f171.google.com with SMTP id 17so17897801iea.2 for ; Thu, 29 Nov 2012 15:17:10 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=OvfRXAY7JXHKiL+rlnzQ71N3bQMIm/a3ikkhQuLvcSw=; b=AN5hoQHpLBZij8zUYDYKE3LeyhoKXzdYirxwE1SXUhmGncJj3TkQvz394Cnoy3o+GO 4N4WwhUkN/98qVaRrMvKGq5/dWCVN1NJmenpkEcWI2aUBDQSuTJYAczhcMdbLNsYFqoz Hs3enM6JbJsiKkpX42f7ib/GXtw+e1ZMSX8hqDjFIb1Ochp0mn41GlpaVa1gIVcmDZkl nGxaDEUcHjjDVv/mym7ZAvdzZ3ddvvSvHLqFNJqolRuh3win3d1RslZLlAmzGvkm2TNq dvK+8Aj31fOIRM7xHcE62rwmJ5Eu7/FYCu7ern6Px/piJ5zeBkpAc3kaBm6z3uk7Uh1N 7cAA== MIME-Version: 1.0 Received: by 10.50.195.130 with SMTP id ie2mr24774443igc.40.1354231029832; Thu, 29 Nov 2012 15:17:09 -0800 (PST) Received: by 10.50.50.1 with HTTP; Thu, 29 Nov 2012 15:17:09 -0800 (PST) In-Reply-To: <1354122170121-4659891.post@n4.nabble.com> References: <1354122170121-4659891.post@n4.nabble.com> Date: Thu, 29 Nov 2012 16:17:09 -0700 Message-ID: Subject: Re: Large message failure over http transport From: Christian Posta To: "users@activemq.apache.org" Content-Type: multipart/alternative; boundary=14dae9340a817a1adf04cfaa7b16 X-Virus-Checked: Checked by ClamAV on apache.org --14dae9340a817a1adf04cfaa7b16 Content-Type: text/plain; charset=ISO-8859-1 Can you post your broker config? I have been trying 10MB payloads and they work fine. In IRC i mentioned I was getting OOM, but my test case was trying to send 100MB payloads, not 10MB. Also, is your exception stack trace from the client side? Or broker side? On Wed, Nov 28, 2012 at 10:02 AM, mrloud wrote: > Extracted from IRC chat with cposta: > > I'm getting "IOException: Could not post command" using the http transport > on AMQ 5.7. Any tips on what I should be looking at to fix this? This is > going to be a low volume, but possibly large message size, server. > > I'm sending in a TextMessage with text set to a string created from an > empty > byte array, just so I can experiment with sizes. > 10mb fails, 5mb completes ususally, just ran a 6mb and it completed, 7mb > failed with same error > We are going to be pretty low volume, maybe 500-600 messages a day, but the > payloads can be larger > heap size is 1024mb > > Client Trace: > > javax.jms.JMSException: Could not post command: ActiveMQTextMessage > {commandId = 5, responseRequired = false, messageId = > ID:tsg3038-50643-1354119150216-1:1:1:1:1, originalDestination = null, > originalTransactionId = null, producerId = > ID:tsg3038-50643-1354119150216-1:1:1:1, destination = queue://FOO.BAR, > transactionId = null, expiration = 0, timestamp = 1354119150836, arrival = > 0, brokerInTime = 0, brokerOutTime = 0, correlationId = null, replyTo = > null, persistent = true, type = null, priority = 4, groupID = null, > groupSequence = 0, targetConsumerId = null, compressed = false, userID = > null, content = null, marshalledProperties = null, dataStructure = null, > redeliveryCounter = 0, size = 0, properties = {dealerAccount=123456, > QuoteTypeID=2, PONumber=0, RequestFrom=FromSendToWorkflow, > QuoteID=7312264}, > readOnlyProperties = true, readOnlyBody = true, droppable = false, text = > ... > at > > org.apache.activemq.util.JMSExceptionSupport.create(JMSExceptionSupport.java:62) > at > > org.apache.activemq.ActiveMQConnection.doAsyncSendPacket(ActiveMQConnection.java:1245) > at > > org.apache.activemq.ActiveMQConnection.asyncSendPacket(ActiveMQConnection.java:1237) > at > org.apache.activemq.ActiveMQSession.send(ActiveMQSession.java:1738) > at > > org.apache.activemq.ActiveMQMessageProducer.send(ActiveMQMessageProducer.java:231) > at > > org.apache.activemq.ActiveMQMessageProducerSupport.send(ActiveMQMessageProducerSupport.java:241) > at mqtest.MQTest.publish(MQTest.java:167) > at mqtest.HttpLoadTest$TestThread.run(HttpLoadTest.java:101) > Caused by: java.io.IOException: Could not post command: ActiveMQTextMessage > {commandId = 5, responseRequired = false, messageId = > ID:tsg3038-50643-1354119150216-1:1:1:1:1, originalDestination = null, > originalTransactionId = null, producerId = > ID:tsg3038-50643-1354119150216-1:1:1:1, destination = queue://FOO.BAR, > transactionId = null, expiration = 0, timestamp = 1354119150836, arrival = > 0, brokerInTime = 0, brokerOutTime = 0, correlationId = null, replyTo = > null, persistent = true, type = null, priority = 4, groupID = null, > groupSequence = 0, targetConsumerId = null, compressed = false, userID = > null, content = null, marshalledProperties = null, dataStructure = null, > redeliveryCounter = 0, size = 0, properties = {dealerAccount=123456, > QuoteTypeID=2, PONumber=0, RequestFrom=FromSendToWorkflow, > QuoteID=7312264}, > readOnlyProperties = true, readOnlyBody = true, droppable = false, text = > ... > at > > org.apache.activemq.util.IOExceptionSupport.create(IOExceptionSupport.java:33) > at > > org.apache.activemq.transport.http.HttpClientTransport.oneway(HttpClientTransport.java:101) > at > org.apache.activemq.transport.MutexTransport.oneway(MutexTransport.java:40) > at > > org.apache.activemq.transport.ResponseCorrelator.oneway(ResponseCorrelator.java:60) > at > > org.apache.activemq.ActiveMQConnection.doAsyncSendPacket(ActiveMQConnection.java:1243) > ... 6 more > Caused by: java.io.IOException: Could not post command: ActiveMQTextMessage > {commandId = 5, responseRequired = false, messageId = > ID:tsg3038-50643-1354119150216-1:1:1:1:1, originalDestination = null, > originalTransactionId = null, producerId = > ID:tsg3038-50643-1354119150216-1:1:1:1, destination = queue://FOO.BAR, > transactionId = null, expiration = 0, timestamp = 1354119150836, arrival = > 0, brokerInTime = 0, brokerOutTime = 0, correlationId = null, replyTo = > null, persistent = true, type = null, priority = 4, groupID = null, > groupSequence = 0, targetConsumerId = null, compressed = false, userID = > null, content = null, marshalledProperties = null, dataStructure = null, > redeliveryCounter = 0, size = 0, properties = {dealerAccount=123456, > QuoteTypeID=2, PONumber=0, RequestFrom=FromSendToWorkflow, > QuoteID=7312264}, > readOnlyProperties = true, readOnlyBody = true, droppable = false, text = > ... > at > > org.apache.activemq.transport.http.HttpClientTransport.oneway(HttpClientTransport.java:91) > ... 9 more > > Server Trace: > > 2012-11-28 10:12:45,266 | ERROR | / | org.mortbay.log | btpool1-3 > com.thoughtworks.xstream.converters.ConversionException: : error reading > input, returned 0 : : error reading input, returned 0 > ---- Debugging information ---- > message : : error reading input, returned 0 > cause-exception : com.thoughtworks.xstream.io.StreamException > cause-message : : error reading input, returned 0 > class : org.apache.activemq.command.ActiveMQTextMessage > required-type : java.lang.String > path : /org.apache.activemq.command.ActiveMQTextMessage/text > line number : 54 > ------------------------------- > at > > com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:89) > at > > com.thoughtworks.xstream.core.AbstractReferenceUnmarshaller.convert(AbstractReferenceUnmarshaller.java:63) > at > > com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:76) > at > > com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshallField(AbstractReflectionConverter.java:246) > at > > com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.doUnmarshal(AbstractReflectionConverter.java:218) > at > > com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:162) > at > > com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:82) > at > > com.thoughtworks.xstream.core.AbstractReferenceUnmarshaller.convert(AbstractReferenceUnmarshaller.java:63) > at > > com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:76) > at > > com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:60) > at > > com.thoughtworks.xstream.core.TreeUnmarshaller.start(TreeUnmarshaller.java:137) > at > > com.thoughtworks.xstream.core.AbstractTreeMarshallingStrategy.unmarshal(AbstractTreeMarshallingStrategy.java:33) > at com.thoughtworks.xstream.XStream.unmarshal(XStream.java:923) > at com.thoughtworks.xstream.XStream.unmarshal(XStream.java:909) > at com.thoughtworks.xstream.XStream.fromXML(XStream.java:853) > at > > org.apache.activemq.transport.xstream.XStreamWireFormat.unmarshalText(XStreamWireFormat.java:55) > at > > org.apache.activemq.transport.http.HttpTunnelServlet.doPost(HttpTunnelServlet.java:102) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:713) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:806) > at > org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:487) > at > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:362) > at > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:181) > at > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:726) > at > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > at org.mortbay.jetty.Server.handle(Server.java:324) > at > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:505) > at > > org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:842) > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:648) > at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:205) > at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:380) > at > > org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) > at > > org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:450) > Caused by: com.thoughtworks.xstream.io.StreamException: : error reading > input, returned 0 > at > com.thoughtworks.xstream.io.xml.XppReader.pullNextEvent(XppReader.java:80) > at > > com.thoughtworks.xstream.io.xml.AbstractPullReader.readRealEvent(AbstractPullReader.java:137) > at > > com.thoughtworks.xstream.io.xml.AbstractPullReader.readEvent(AbstractPullReader.java:124) > at > > com.thoughtworks.xstream.io.xml.AbstractPullReader.getValue(AbstractPullReader.java:167) > at > com.thoughtworks.xstream.io.ReaderWrapper.getValue(ReaderWrapper.java:48) > at > > com.thoughtworks.xstream.converters.SingleValueConverterWrapper.unmarshal(SingleValueConverterWrapper.java:49) > at > > com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:82) > ... 31 more > Caused by: java.io.IOException: error reading input, returned 0 > at org.xmlpull.mxp1.MXParser.fillBuf(MXParser.java:2991) > at org.xmlpull.mxp1.MXParser.more(MXParser.java:2996) > at org.xmlpull.mxp1.MXParser.parseEntityRef(MXParser.java:2151) > at org.xmlpull.mxp1.MXParser.nextImpl(MXParser.java:1274) > at org.xmlpull.mxp1.MXParser.next(MXParser.java:1092) > at > com.thoughtworks.xstream.io.xml.XppReader.pullNextEvent(XppReader.java:63) > ... 37 more > > > > > -- > View this message in context: > http://activemq.2283324.n4.nabble.com/Large-message-failure-over-http-transport-tp4659891.html > Sent from the ActiveMQ - User mailing list archive at Nabble.com. > -- *Christian Posta* http://www.christianposta.com/blog twitter: @christianposta --14dae9340a817a1adf04cfaa7b16--