camel-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Damian Harvey <damian.har...@aon.com.au>
Subject RE: Performance
Date Mon, 10 Jan 2011 01:31:16 GMT
Willem,

The 1000 milliseconds in the SedaConsumer.run() method is a timeout and not a delay. The javadoc
says: "Retrieves and removes the head of this queue, waiting up to the specified wait time
if necessary for an element to become available."

So if a message is available it will take it immediately.

Regards,

Damian.

-----Original Message-----
From: Willem Jiang [mailto:willem.jiang@gmail.com]
Sent: Monday, 10 January 2011 11:45 AM
To: users@camel.apache.org
Subject: Re: Performance


If you take a look at the SedaConsumer.run()[1] method, you will find it pull the queue every
second, maybe we could introduce some configuration for it to seda to short the delay.

[1]https://svn.apache.org/repos/asf/camel/trunk/camel-core/src/main/java/org/apache/camel/component/seda/SedaConsumer.java

On 1/10/11 8:09 AM, Damian Harvey wrote:
> I'm running performance tests and noticing that under load I am getting increasingly
large amounts of time spent in the SEDA queues.
>
> For example below are some lines from my log when the app is under load (20 concurrent
threads). The first is from one Route (Get360List) that then call the calls the 3 routes via
multicast in parallel (GetPolicyList, GetFeeList, GetClaimList).
>
> There is a ~600ms delay between the multicast being called and the Consumers on those
SEDA queues picking up the messages. I have 30 concurrent consumers set for each SEDA endpoint,
so I would have thought that there would be no shortage of consumers to pull messages from
these queues.
>
> Are there any other settings that I should be looking at to reduce this delay?
>
> 2011-01-10 10:57:02,249 [a://get360Start] INFO  Aon_360Request                 -(ID-aon43098-1487-1294617268515-0-3526)
Started Single Client AONZBAD2571 for Get360List
> 2011-01-10 10:57:02,827 [PolicyListStart] INFO  Aon_GetPolicyListRoute         -(ID-aon43098-1487-1294617268515-0-3526)
Starting Single-Client for GetPolicyList
> 2011-01-10 10:57:02,827 [PolicyListStart] INFO  ExecProducer                   -(ID-aon43098-1487-1294617268515-0-3526)
Executing ExecCommand [args=[cbslocal, AONZBAD2571PDTrue], executable=C:/workspaces/CRMS/MockCBS/GetPolicyList.bat,
timeout=9223372036854775807, outFile=null, workingDir=null, useStderrOnEmptyStdout=true]
> 2011-01-10 10:57:02,827 [PolicyListStart] INFO  GetOsCmdRouteBuilder$1         -(ID-aon43098-1487-1294617268515-0-3526)
Calling command: C:/workspaces/CRMS/MockCBS/GetPolicyList.bat cbslocal AONZBAD2571PDTrue
> 2011-01-10 10:57:02,827 [getFeeListStart] INFO  Aon_GetFeeListRoute            -(ID-aon43098-1487-1294617268515-0-3526)
Starting Single-Client for GetFeeList
> 2011-01-10 10:57:02,827 [tClaimListStart] INFO  Aon_GetClaimListRoute          -(ID-aon43098-1487-1294617268515-0-3526)
Starting Single-Client for GetClaimList
> 2011-01-10 10:57:02,827 [tClaimListStart] INFO  GetOsCmdRouteBuilder$1         -(ID-aon43098-1487-1294617268515-0-3526)
Calling command: C:/workspaces/CRMS/MockCBS/GetClaimList.bat cbslocal AONZBAD2571TrueD
> 2011-01-10 10:57:03,015 [PolicyListStart] INFO  ExecProducer                   -(ID-aon43098-1487-1294617268515-0-3526)
The command ExecCommand [args=[cbslocal, AONZBAD2571PDTrue], executable=C:/workspaces/CRMS/MockCBS/GetPolicyList.bat,
timeout=9223372036854775807, outFile=null, workingDir=null, useStderrOnEmptyStdout=true] had
exit value 0
> 2011-01-10 10:57:03,499 [PolicyListStart] INFO  Aon_GetPolicyListRoute         -(ID-aon43098-1487-1294617268515-0-3526)
Finished processing single Client for GetPolicyList
> 2011-01-10 10:57:03,593 [getFeeListStart] INFO  GetOsCmdRouteBuilder$1         -(ID-aon43098-1487-1294617268515-0-3526)
Calling command: C:/workspaces/CRMS/MockCBS/GetFeeList.bat cbslocal AONZBAD2571TrueD
> 2011-01-10 10:57:03,593 [tClaimListStart] INFO  ExecProducer                   -(ID-aon43098-1487-1294617268515-0-3526)
Executing ExecCommand [args=[cbslocal, AONZBAD2571TrueD], executable=C:/workspaces/CRMS/MockCBS/GetClaimList.bat,
timeout=9223372036854775807, outFile=null, workingDir=null, useStderrOnEmptyStdout=true]
> 2011-01-10 10:57:03,718 [getFeeListStart] INFO  ExecProducer                   -(ID-aon43098-1487-1294617268515-0-3526)
Executing ExecCommand [args=[cbslocal, AONZBAD2571TrueD], executable=C:/workspaces/CRMS/MockCBS/GetFeeList.bat,
timeout=9223372036854775807, outFile=null, workingDir=null, useStderrOnEmptyStdout=true]
> 2011-01-10 10:57:03,796 [tClaimListStart] INFO  ExecProducer                   -(ID-aon43098-1487-1294617268515-0-3526)
The command ExecCommand [args=[cbslocal, AONZBAD2571TrueD], executable=C:/workspaces/CRMS/MockCBS/GetClaimList.bat,
timeout=9223372036854775807, outFile=null, workingDir=null, useStderrOnEmptyStdout=true] had
exit value 0
> 2011-01-10 10:57:03,874 [getFeeListStart] INFO  ExecProducer                   -(ID-aon43098-1487-1294617268515-0-3526)
The command ExecCommand [args=[cbslocal, AONZBAD2571TrueD], executable=C:/workspaces/CRMS/MockCBS/GetFeeList.bat,
timeout=9223372036854775807, outFile=null, workingDir=null, useStderrOnEmptyStdout=true] had
exit value 0
> 2011-01-10 10:57:04,608 [getFeeListStart] INFO  Aon_GetFeeListRoute            -(ID-aon43098-1487-1294617268515-0-3526)
Finished processing single Client for GetFeeList
> 2011-01-10 10:57:04,655 [tClaimListStart] INFO  Aon_GetClaimListRoute          -(ID-aon43098-1487-1294617268515-0-3526)
Finished processing single Client for GetClaimList
> 2011-01-10 10:57:05,155 [a://get360Start] INFO  Aon_360Request                 -(ID-aon43098-1487-1294617268515-0-3526)
Finished processing Single Client AONZBAD2571 for Get360List
>
> Thanks,
>
> Damian.
>
>
> Damian Harvey | Aon Australia/Pacific
>
> Level 31, 201 Kent Street Sydney NSW 2000
> t: +61292537000 | f: +61292537952
> e: damian.harvey@aon.com.au<mailto:damian.harvey@aon.com.au>
>
> Please consider the environment before printing this email.
>
> ________________________________
>
> This communication (and any attachments) is directed in confidence to the addressee(s)
listed above, and may not otherwise be distributed, copied or used. The contents of this communication
may also be subject to privilege, and all rights to that privilege are expressly claimed and
not waived. If you have received this communication in error, please notify us by reply e-mail
or by telephone and delete this communication (and any attachments) without making a copy.
>
> Before opening or using attachments, you should check them for viruses and defects. We
do not accept liability in connection with computer virus, data corruption, delay, interruption,
unauthorised access or unauthorised amendment.
>


--
Willem
----------------------------------
FuseSource
Web: http://www.fusesource.com
Blog:    http://willemjiang.blogspot.com (English)
          http://jnn.javaeye.com (Chinese)
Twitter: willemjiang


This communication (and any attachments) is directed in confidence to the addressee(s) listed
above, and may not otherwise be distributed, copied or used. The contents of this communication
may also be subject to privilege, and all rights to that privilege are expressly claimed and
not waived. If you have received this communication in error, please notify us by reply e-mail
or by telephone and delete this communication (and any attachments) without making a copy.

Before opening or using attachments, you should check them for viruses and defects. We do
not accept liability in connection with computer virus, data corruption, delay, interruption,
unauthorised access or unauthorised amendment.


Mime
View raw message