activemq-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marc Weil <marc.w...@gmail.com>
Subject Re: Large BLOBs cause crash with IllegalArgumentException
Date Wed, 03 Feb 2010 14:20:55 GMT
Does anyone have any information on how to set up BLOB messages to use SCP?
I never received a response to my question from a few days ago.

Thanks!
Marc

On Sat, Jan 30, 2010 at 3:54 PM, Marc Weil <marc.weil@gmail.com> wrote:

> Thanks for the help, guys. Is the syntax for using SCP and SFTP with this
> the same? I figure that SFTP is, but with SCP you usually have to give a
> target directory on the remote host and I'm not sure how to configure it so
> activemq knows where to find it nor am I sure what the syntax for that part
> would look like. Or does activemq take care of that on its own?
>
> Also, I'll re-run my test with jetty debug logging enabled and send you
> what is printed.
>
> Thanks again,
> Marc
>
>
> On Sat, Jan 30, 2010 at 2:35 PM, Gary Tully <gary.tully@gmail.com> wrote:
>
>> There was a recent fix for large messages over FTP so you may need
>> https://issues.apache.org/activemq/browse/AMQ-2548 Actually that is one
>> we
>> should pull into 5.3.1 asap.
>>
>> wonder if the jetty server has some sort of timeout that is causing the
>> connection to close, does debug logging help?
>>
>> On 30 January 2010 11:26, Dejan Bosanac <dejan@nighttale.net> wrote:
>>
>> > Hi Marc,
>> >
>> > for messages of that size, I'd definitely recommend using FTP. You can
>> find
>> > examples of how to use FTP with blob messages in this test case
>> >
>> >
>> >
>> http://fisheye6.atlassian.com/browse/activemq/trunk/activemq-core/src/test/java/org/apache/activemq/blob/FTPBlobTest.java?r=HEAD
>> >
>> > (and some more in that package).
>> >
>> > Of course, tests are using embedded FTP server, but you might opt for an
>> > external one.
>> >
>> > Cheers
>> > --
>> > Dejan Bosanac - http://twitter.com/dejanb
>> >
>> > Open Source Integration - http://fusesource.com/
>> > ActiveMQ in Action - http://www.manning.com/snyder/
>> > Blog - http://www.nighttale.net
>> >
>> >
>> > On Sat, Jan 30, 2010 at 3:43 AM, Marc Weil <marc.weil@gmail.com> wrote:
>> >
>> > > Hello everyone,
>> > >
>> > > I'm trying to send a large (~1.6GB) BlobMessage to my ActiveMQ server
>> via
>> > a
>> > > queue and every time I try I get a seemingly endless series
>> > > of IllegalArgumentExceptions with the same backtrace:
>> > >
>> > > ERROR | EXCEPTION
>> > > java.lang.IllegalArgumentException
>> > >        at java.nio.Buffer.position(Buffer.java:235)
>> > >        at org.mortbay.io.nio.NIOBuffer.poke(NIOBuffer.java:142)
>> > >        at org.mortbay.io.AbstractBuffer.put(AbstractBuffer.java:391)
>> > >        at org.mortbay.jetty.HttpParser.reset(HttpParser.java:844)
>> > >        at
>> > org.mortbay.jetty.HttpConnection.destroy(HttpConnection.java:131)
>> > >        at
>> > >
>> > >
>> >
>> org.mortbay.jetty.AbstractConnector.connectionClosed(AbstractConnector.java:785)
>> > >        at
>> > >
>> > >
>> >
>> org.mortbay.jetty.nio.SelectChannelConnector.access$100(SelectChannelConnector.java:64)
>> > >        at
>> > >
>> > >
>> >
>> org.mortbay.jetty.nio.SelectChannelConnector$1.endPointClosed(SelectChannelConnector.java:92)
>> > >        at
>> > >
>> > >
>> >
>> org.mortbay.io.nio.SelectChannelEndPoint.doUpdateKey(SelectChannelEndPoint.java:382)
>> > >        at
>> > >
>> > >
>> >
>> org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:337)
>> > >        at
>> > > org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:166)
>> > >        at
>> > >
>> > >
>> >
>> org.mortbay.jetty.nio.SelectChannelConnector.accept(SelectChannelConnector.java:124)
>> > >        at
>> > >
>> > >
>> >
>> org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:537)
>> > >        at
>> > >
>> > >
>> >
>> org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:450)
>> > >
>> > >
>> > > I'm assuming this is coming from the built-in Jetty fileserver. I've
>> > > googled
>> > > around for quite a while but can't seem to find anything recent about
>> > this
>> > > problem. I am giving ActiveMQ 5Gb of RAM in the startup script, so I
>> > don't
>> > > think that is the issue (unless jetty also needs to be forced to start
>> > with
>> > > a certain heap size).
>> > >
>> > > My server is a 4-processor, 8-core machine running Ubuntu x86-64,
>> > ActiveMQ
>> > > 5.3.0, and OpenJDK 1.6.0 64-bit server edition. The machine itself has
>> > 32Gb
>> > > of RAM so I have plenty of memory to play with.
>> > >
>> > > I'm not really sure what else to use since the docs on BlobMessages
>> only
>> > > briefly mentions using other out-of-band solutions (SCP, FTP, etc)
>> > without
>> > > going into any details. If anyone has any ideas of where I need to
>> look
>> > to
>> > > trace the root cause, or has any other ideas about how to try
>> configuring
>> > > things, I'd greatly appreciate it. Perhaps I'm not supposed to be
>> using
>> > the
>> > > built-in jetty server for such large messages?
>> > >
>> > > Thanks,
>> > > Marc
>> > >
>> >
>>
>>
>>
>> --
>> http://blog.garytully.com
>>
>> Open Source Integration
>> http://fusesource.com
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message