activemq-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GaryG <ggive...@us.ibm.com>
Subject Re: Queue question
Date Mon, 05 Feb 2007 20:46:09 GMT

[backfilling some messages]


GaryG wrote:
> 
> 
> On 2/5/07, Givental, Gary  wrote:
>> Ah yes, I should have clarified that :)
>>
>> The nature of the applications makes that impossible.  We need to 
>> ensure that A) all the tasks are processed in sequential order, B) 
>> each work task is tied to a specific business entity.  If 2 tasks need 
>> to be done for the same business entity, they *must* be processed in 
>> time-sequential order, and be processed by the Worker.
>>
>> These two requirements do not allow us to use a Queue for all the 
>> worker tasks, since that would mean they they might be processed out 
>> of order, and even worse, 2 tasks for the same business entity might 
>> be processed out of time-sequence.
> 
> 
> 



> Aha. Looks like you need to use Message Groups. Using the business entity
> as the JMSXGroupID value - then you get load balancing across your
> business entities and workers - yet each business entity's messages are
> processed in time-sequential order
> 
> http://activemq.apache.org/message-groups.html
> 
> If you need to preserve the order of all messages across all business
> entities (i.e. process all messages essentially single threaded), then you
> could use Exclusive Consumers
> 
> http://activemq.apache.org/exclusive-consumer.html
> 
> in either case, the broker does the hard work of tracking workers and load
> balancing etc
> -- 
> James
> 


In response to this, James, does it effect performance negatively to have
thousands of message groups?  on the order of 10,000?  

Also, it sounds like Message Groups are Topics (publish/subscribe) is that
correct? 

What about the use case (building on the Stock Symbols example on the
activemq site) where perhaps all the Stock Symbols (MSFT, IBM, etc) are
unique Message Groups, but we also want to group all the stock that are for
Internet Companies, and a group for all the automotive industry companies,
etc...is there sub-grouping in other words?

I'm also concerned about memory requirements and performance of the broker
itself 
-- 
View this message in context: http://www.nabble.com/Queue-question-tf3157001.html#a8814454
Sent from the ActiveMQ - User mailing list archive at Nabble.com.


Mime
View raw message