Mailing-List: contact dev-help@camel.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@camel.apache.org
From: Quinn Stevenson <quinn@pronoia-solutions.com>
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Mime-Version: 1.0 (Mac OS X Mail 10.2 \(3259\))
Subject: Re: is it better to use aggregator to write a large file hourly using
 messages from active mq queue?
Date: Wed, 28 Dec 2016 08:56:09 -0700
References: <1482298968159-5791784.post@n5.nabble.com>
To: dev@camel.apache.org
In-Reply-To: <1482298968159-5791784.post@n5.nabble.com>
Message-Id: <6A9CFC2D-7DA3-40E4-90DC-48120E08DCF6@pronoia-solutions.com>
archived-at: Wed, 28 Dec 2016 15:56:25 -0000

For a requirement such as this, I would probably schedule a route to =
start hourly and write the file rather than use an aggregator.  The =
reason for this is I normally can=E2=80=99t lose any messages and if I =
use an aggregator I need to have a persistent aggregation repository as =
well to ensure I don=E2=80=99t lose any message.  Since my messages are =
already persisted in the JMS store, I don=E2=80=99t really see much =
value in moving them from one store to another, just to hold them until =
I write the file. =20

For this use case, you may also be able to just append to a file since =
your filename has the timestamp in it - i.e use a fileName pattern like =
yyyyMMddHH.txt and just append the records to it as they come in.  I =
don=E2=80=99t know if that would satisfy your use case or not.

As far as whether or not it=E2=80=99s better to use an aggregator - it =
depends on the use case.  The use case you=E2=80=99ve given can be =
accomplished without an aggregator, but I=E2=80=99ve had others that =
require an aggregator.  For me, its really a matter of what method fits =
the use case better.

HTH

> On Dec 20, 2016, at 10:42 PM, beschi <beschi.agent@gmail.com> wrote:
>=20
> I have a requirement of creating a large file hourly, the content of =
the
> files will be the records/line from active mq queue.
>=20
> I am using the following code, is there any better option?
>=20
> 		<route id=3D"largeFileWritter">
> 			<from uri=3D"activemq:queue:so.file.req.in"/>
> 			<log loggingLevel=3D"INFO" message=3D"Adding =
record to  File ${body}" />
> 			<camel:setHeader headerName=3D"fileName">
> 				<camel:simple>Test =
File_${date:now:yyyyMMddHHmmssSSS}.txt</camel:simple>
> 			</camel:setHeader>
> 			<aggregate strategyRef=3D"aggregatorStrategy" =
forceCompletionOnStop=3D"true"
> completionInterval=3D"8600000">
>            	<correlationExpression>
>                	<constant>true</constant>
>            	</correlationExpression>
>            	<to
> =
uri=3D"file://d:/temp/temp1?fileExist=3DAppend&amp;fileName=3D${headers.fi=
leName}"
> />
>        	</aggregate>
> 		</route>
>=20
>=20
>=20
> --
> View this message in context: =
http://camel.465427.n5.nabble.com/is-it-better-to-use-aggregator-to-write-=
a-large-file-hourly-using-messages-from-active-mq-queue-tp5791784.html
> Sent from the Camel Development mailing list archive at Nabble.com.