Mailing-List: contact users-help@camel.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@camel.apache.org
Received-SPF: pass (athena.apache.org: domain of bruce.snyder@gmail.com
 designates 209.85.220.207 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:content-transfer-encoding;
        b=WJ3K2PwBxxccZRyEY1slU9g9n2Qb/Z4tFHgwKNEFsNmlJTN71cB325EZK4KjYkx2/M
         uVq4Z0SuGyit3eXJ3gHDeXBppMs16Zq2FnN/mq6xQ+p2/2fLlJbSrcRoDiQAsGRHYmG8
         p1h4HNCFmVDFb3w3eI0fsKC9ccEyJPAaGnnbw=
MIME-Version: 1.0
In-Reply-To: <25924781.post@talk.nabble.com>
References: <25826380.post@talk.nabble.com>
	 <5380c69c0910140607w3fb011e7xca420a20ac2ad504@mail.gmail.com>
	 <25890925.post@talk.nabble.com> <25891924.post@talk.nabble.com>
	 <5380c69c0910140721g31eb454cl563d3bc6e5650771@mail.gmail.com>
	 <5380c69c0910140740r33a6e04by9aa0fe2be4f17ed8@mail.gmail.com>
	 <5380c69c0910140746y4d8a7426wce6a163314e22b30@mail.gmail.com>
	 <25898450.post@talk.nabble.com>
	 <5380c69c0910142333m172a5b2au93c8b44ec053c7d5@mail.gmail.com>
	 <25924781.post@talk.nabble.com>
Date: Wed, 21 Oct 2009 13:19:16 -0500
Message-ID: <7b3355cb0910211119w61e8e5e6q9c294164ee53c929@mail.gmail.com>
Subject: Re: handling large files
From: Bruce Snyder <bruce.snyder@gmail.com>
To: users@camel.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

On Fri, Oct 16, 2009 at 7:41 AM, mcarson <mcarson@amsa.com> wrote:
>
> Using the scanner seems to work for parsing down the huge file based upon=
 a
> delimiter. =A0However it appears that either the JmsTemplate I'm using to=
 send
> messages or ActiveMQ cannot keep pace.
>
> Somewhere between 250K - 500K sends, I get this stack trace:
>
> Exception in thread "main"
> org.springframework.jms.UncategorizedJmsException: Uncategorized exceptio=
n
> occured during JMS processing; nested exception is javax.jms.JMSException=
:
> java.io.EOFException
> =A0 =A0 =A0 =A0at
> org.springframework.jms.support.JmsUtils.convertJmsAccessException(JmsUti=
ls.java:308)
> =A0 =A0 =A0 =A0at
> org.springframework.jms.support.JmsAccessor.convertJmsAccessException(Jms=
Accessor.java:168)
> =A0 =A0 =A0 =A0at org.springframework.jms.core.JmsTemplate.execute(JmsTem=
plate.java:474)
> =A0 =A0 =A0 =A0at org.springframework.jms.core.JmsTemplate.send(JmsTempla=
te.java:548)
> =A0 =A0 =A0 =A0at asa.camel.TestScanner.parseRecord(TestScanner.java:62)
> =A0 =A0 =A0 =A0at asa.camel.TestScanner.readFile(TestScanner.java:34)
> =A0 =A0 =A0 =A0at asa.camel.TestScanner.main(TestScanner.java:82)
> Caused by: javax.jms.JMSException: java.io.EOFException
> =A0 =A0 =A0 =A0at
> org.apache.activemq.util.JMSExceptionSupport.create(JMSExceptionSupport.j=
ava:49)
> =A0 =A0 =A0 =A0at
> org.apache.activemq.ActiveMQConnection.syncSendPacket(ActiveMQConnection.=
java:1244)
> =A0 =A0 =A0 =A0at
> org.apache.activemq.ActiveMQConnection.ensureConnectionInfoSent(ActiveMQC=
onnection.java:1339)
> =A0 =A0 =A0 =A0at
> org.apache.activemq.ActiveMQConnection.createSession(ActiveMQConnection.j=
ava:298)
> =A0 =A0 =A0 =A0at
> org.springframework.jms.support.JmsAccessor.createSession(JmsAccessor.jav=
a:196)
> =A0 =A0 =A0 =A0at org.springframework.jms.core.JmsTemplate.execute(JmsTem=
plate.java:462)
> =A0 =A0 =A0 =A0... 4 more
> Caused by: java.io.EOFException
> =A0 =A0 =A0 =A0at java.io.DataInputStream.readInt(DataInputStream.java:37=
5)
> =A0 =A0 =A0 =A0at
> org.apache.activemq.openwire.OpenWireFormat.unmarshal(OpenWireFormat.java=
:269)
> =A0 =A0 =A0 =A0at
> org.apache.activemq.transport.tcp.TcpTransport.readCommand(TcpTransport.j=
ava:210)
> =A0 =A0 =A0 =A0at
> org.apache.activemq.transport.tcp.TcpTransport.doRun(TcpTransport.java:20=
2)
> =A0 =A0 =A0 =A0at
> org.apache.activemq.transport.tcp.TcpTransport.run(TcpTransport.java:185)
> =A0 =A0 =A0 =A0at java.lang.Thread.run(Thread.java:619)
>
> Any ideas what could cause this?

I'm not sure what kind of configuration you're using for ActiveMQ, but
are you utilizing a connection pooler so that the the connection,
session and producer are not recreated for every call to send()? See
the following for more info:

http://activemq.apache.org/jmstemplate-gotchas.html

Bruce
--=20
perl -e 'print unpack("u30","D0G)U8V4\@4VYY9&5R\"F)R=3D6-E+G-N>61E<D\!G;6%I=
;\"YC;VT*"
);'

ActiveMQ in Action: http://bit.ly/2je6cQ
Blog: http://bruceblog.org/
Twitter: http://twitter.com/brucesnyder