camel-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Damian Harvey <damian.har...@aon.com.au>
Subject RE: Performance
Date Mon, 10 Jan 2011 21:08:20 GMT
Claus,

I'm using 2.5. I'll pull down the latest and try that.

Is my understanding correct in that these settings should allow for this number of concurrent
users?

Thanks,

Damian.

-----Original Message-----
From: Claus Ibsen [mailto:claus.ibsen@gmail.com]
Sent: Tuesday, 11 January 2011 1:16 AM
To: users@camel.apache.org
Subject: Re: Performance

What version of Camel do you use?

I found an issue in Camel 2.5 with the seda component. There is some special logic if you
use the option multipleConsumers which is used to multicast messages to multiple consumers.
And this requires thread pool in the work doing that, as its parallel processing that work.
Unfortunately the issue in Camel 2.5 is that it creates those thread pool, even if its not
needed.

I have fixed it on trunk
https://issues.apache.org/jira/browse/CAMEL-3523

So this may impact a system if you use a lot of seda endpoints.

In your case you can try using a profiler to see if it can help identify bottlenecks.
For example YourKit is a good profiler.


On Mon, Jan 10, 2011 at 1:09 AM, Damian Harvey <damian.harvey@aon.com.au> wrote:
> I'm running performance tests and noticing that under load I am getting increasingly
large amounts of time spent in the SEDA queues.
>
> For example below are some lines from my log when the app is under load (20 concurrent
threads). The first is from one Route (Get360List) that then call the calls the 3 routes via
multicast in parallel (GetPolicyList, GetFeeList, GetClaimList).
>
> There is a ~600ms delay between the multicast being called and the Consumers on those
SEDA queues picking up the messages. I have 30 concurrent consumers set for each SEDA endpoint,
so I would have thought that there would be no shortage of consumers to pull messages from
these queues.
>
> Are there any other settings that I should be looking at to reduce this delay?
>
> 2011-01-10 10:57:02,249 [a://get360Start] INFO  Aon_360Request
> -(ID-aon43098-1487-1294617268515-0-3526) Started Single Client
> AONZBAD2571 for Get360List
> 2011-01-10 10:57:02,827 [PolicyListStart] INFO  Aon_GetPolicyListRoute
> -(ID-aon43098-1487-1294617268515-0-3526) Starting Single-Client for
> GetPolicyList
> 2011-01-10 10:57:02,827 [PolicyListStart] INFO  ExecProducer
> -(ID-aon43098-1487-1294617268515-0-3526) Executing ExecCommand
> [args=[cbslocal, AONZBAD2571PDTrue],
> executable=C:/workspaces/CRMS/MockCBS/GetPolicyList.bat,
> timeout=9223372036854775807, outFile=null, workingDir=null,
> useStderrOnEmptyStdout=true]
> 2011-01-10 10:57:02,827 [PolicyListStart] INFO  GetOsCmdRouteBuilder$1
> -(ID-aon43098-1487-1294617268515-0-3526) Calling command:
> C:/workspaces/CRMS/MockCBS/GetPolicyList.bat cbslocal
> AONZBAD2571PDTrue
> 2011-01-10 10:57:02,827 [getFeeListStart] INFO  Aon_GetFeeListRoute
> -(ID-aon43098-1487-1294617268515-0-3526) Starting Single-Client for
> GetFeeList
> 2011-01-10 10:57:02,827 [tClaimListStart] INFO  Aon_GetClaimListRoute
> -(ID-aon43098-1487-1294617268515-0-3526) Starting Single-Client for
> GetClaimList
> 2011-01-10 10:57:02,827 [tClaimListStart] INFO  GetOsCmdRouteBuilder$1
> -(ID-aon43098-1487-1294617268515-0-3526) Calling command:
> C:/workspaces/CRMS/MockCBS/GetClaimList.bat cbslocal AONZBAD2571TrueD
> 2011-01-10 10:57:03,015 [PolicyListStart] INFO  ExecProducer
> -(ID-aon43098-1487-1294617268515-0-3526) The command ExecCommand
> [args=[cbslocal, AONZBAD2571PDTrue],
> executable=C:/workspaces/CRMS/MockCBS/GetPolicyList.bat,
> timeout=9223372036854775807, outFile=null, workingDir=null,
> useStderrOnEmptyStdout=true] had exit value 0
> 2011-01-10 10:57:03,499 [PolicyListStart] INFO  Aon_GetPolicyListRoute
> -(ID-aon43098-1487-1294617268515-0-3526) Finished processing single
> Client for GetPolicyList
> 2011-01-10 10:57:03,593 [getFeeListStart] INFO  GetOsCmdRouteBuilder$1
> -(ID-aon43098-1487-1294617268515-0-3526) Calling command:
> C:/workspaces/CRMS/MockCBS/GetFeeList.bat cbslocal AONZBAD2571TrueD
> 2011-01-10 10:57:03,593 [tClaimListStart] INFO  ExecProducer
> -(ID-aon43098-1487-1294617268515-0-3526) Executing ExecCommand
> [args=[cbslocal, AONZBAD2571TrueD],
> executable=C:/workspaces/CRMS/MockCBS/GetClaimList.bat,
> timeout=9223372036854775807, outFile=null, workingDir=null,
> useStderrOnEmptyStdout=true]
> 2011-01-10 10:57:03,718 [getFeeListStart] INFO  ExecProducer
> -(ID-aon43098-1487-1294617268515-0-3526) Executing ExecCommand
> [args=[cbslocal, AONZBAD2571TrueD],
> executable=C:/workspaces/CRMS/MockCBS/GetFeeList.bat,
> timeout=9223372036854775807, outFile=null, workingDir=null,
> useStderrOnEmptyStdout=true]
> 2011-01-10 10:57:03,796 [tClaimListStart] INFO  ExecProducer
> -(ID-aon43098-1487-1294617268515-0-3526) The command ExecCommand
> [args=[cbslocal, AONZBAD2571TrueD],
> executable=C:/workspaces/CRMS/MockCBS/GetClaimList.bat,
> timeout=9223372036854775807, outFile=null, workingDir=null,
> useStderrOnEmptyStdout=true] had exit value 0
> 2011-01-10 10:57:03,874 [getFeeListStart] INFO  ExecProducer
> -(ID-aon43098-1487-1294617268515-0-3526) The command ExecCommand
> [args=[cbslocal, AONZBAD2571TrueD],
> executable=C:/workspaces/CRMS/MockCBS/GetFeeList.bat,
> timeout=9223372036854775807, outFile=null, workingDir=null,
> useStderrOnEmptyStdout=true] had exit value 0
> 2011-01-10 10:57:04,608 [getFeeListStart] INFO  Aon_GetFeeListRoute
> -(ID-aon43098-1487-1294617268515-0-3526) Finished processing single
> Client for GetFeeList
> 2011-01-10 10:57:04,655 [tClaimListStart] INFO  Aon_GetClaimListRoute
> -(ID-aon43098-1487-1294617268515-0-3526) Finished processing single
> Client for GetClaimList
> 2011-01-10 10:57:05,155 [a://get360Start] INFO  Aon_360Request
> -(ID-aon43098-1487-1294617268515-0-3526) Finished processing Single
> Client AONZBAD2571 for Get360List
>
> Thanks,
>
> Damian.
>
>
> Damian Harvey | Aon Australia/Pacific
>
> Level 31, 201 Kent Street Sydney NSW 2000
> t: +61292537000 | f: +61292537952
> e: damian.harvey@aon.com.au<mailto:damian.harvey@aon.com.au>
>
> Please consider the environment before printing this email.
>
> ________________________________
>
> This communication (and any attachments) is directed in confidence to the addressee(s)
listed above, and may not otherwise be distributed, copied or used. The contents of this communication
may also be subject to privilege, and all rights to that privilege are expressly claimed and
not waived. If you have received this communication in error, please notify us by reply e-mail
or by telephone and delete this communication (and any attachments) without making a copy.
>
> Before opening or using attachments, you should check them for viruses and defects. We
do not accept liability in connection with computer virus, data corruption, delay, interruption,
unauthorised access or unauthorised amendment.
>



--
Claus Ibsen
-----------------
FuseSource
Email: cibsen@fusesource.com
Web: http://fusesource.com
Twitter: davsclaus
Blog: http://davsclaus.blogspot.com/
Author of Camel in Action: http://www.manning.com/ibsen/


This communication (and any attachments) is directed in confidence to the addressee(s) listed
above, and may not otherwise be distributed, copied or used. The contents of this communication
may also be subject to privilege, and all rights to that privilege are expressly claimed and
not waived. If you have received this communication in error, please notify us by reply e-mail
or by telephone and delete this communication (and any attachments) without making a copy.

Before opening or using attachments, you should check them for viruses and defects. We do
not accept liability in connection with computer virus, data corruption, delay, interruption,
unauthorised access or unauthorised amendment.


Mime
View raw message