qpid-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Virgilio Fornazin <virgilioforna...@gmail.com>
Subject Re: Configuring large queues
Date Thu, 28 Aug 2014 16:35:51 GMT
Gordon

What's the qpidd broker version that started support paging on queues ?


On Tue, Aug 26, 2014 at 5:53 AM, Gordon Sim <gsim@redhat.com> wrote:

> On 08/24/2014 10:23 PM, Graham Leggett wrote:
>
>> I have a need to configure a very large queue that is able to store about
>> 1 million messages of around 10kb each. The queue will be too big to fit
>> into RAM, and will need to spool to disk.
>>
>> I have been struggling to configure the queue, as the queue seems to
>> become full after a few thousand messages. Is there a definitive set of
>> command line options to qpid-config that will create a queue bigger than
>> RAM but that will fit on disk?
>>
>
> Assuming you are using the c++ broker (since you mention qpid-config), if
> you are using a relatively recent version then the best option would be a
> paged queue.
>
> A baisc paged queue can be created with:
>
> qpid-config add queue my-paged-queue --argument qpid.paging=True
>
> You can control the number of pages held in memory with the
> qpid.max_pages_loaded option and the size of the pages with the
> qpid.page_factor option (which indicates how many multiples of the
> platforms page size each qpidd page size is)
>
> If you are using the default value for default-queue-limit then you may
> also want to explicitly make the queue infinite in size and turn off any
> producer flow control which you could do by adding:
>
> --argument qpid.max_size=0 --argument qpid.max_count=0 --argument
> qpid.flow_stop_size= 0 --argument qpid.flow_resume_size=0 --argument
> qpid.flow_stop_count=0 --argument qpid.flow_resume_count=0
>
>
>
>  The errors we have received are related to qpid complaining that failover
>> has failed - which is strange as there is just a single broker with no
>> alternative brokers to fail over to. Does this ring a bell?
>>
>
> What client are you using? Do you have the error in more detail?
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
> For additional commands, e-mail: users-help@qpid.apache.org
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message