camel-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Claus Ibsen <claus.ib...@gmail.com>
Subject Re: general approach to streaming
Date Wed, 03 Dec 2014 13:05:14 GMT
Hi

Maybe take a look at RX Java and the camel-rx component

On Wed, Dec 3, 2014 at 1:24 PM, Tim Dudgeon <tdudgeon.ml@gmail.com> wrote:
> Yes, I know about SEDA, and use it quite a bit, but its not really what I'm
> after here.
> I'm wanting to pass an Iterable such as a Blocking Queue directly between
> processors.
>
> Tim
>
>
> On 28/11/2014 02:44, today wrote:
>>
>> Tim, the SEDA component is designed to produce/consume messages quickly
>> and
>> provides a queue (BlockingQueue) in between resources to buffer the flow
>> and
>> provides options such as max size and blockWhenFull to limit memory usage
>> and slow a producer as needed, etc...
>>
>> http://camel.apache.org/seda.htm
>>
>>
>> Tim Dudgeon wrote
>>>
>>> I've got various cases where I have large number of results (POJOs) and
>>> want to stream them so that:
>>> 1. initial results are returned immediately
>>> 2. memory utilisation is kept under control
>>>
>>> I was expecting to use something like using a BlockingQueue [1] but
>>> according to the Javadocs:
>>>
>>>   > A BlockingQueue does not intrinsically support any kind of "close" or
>>> "shutdown" operation to indicate that no more items will be added.
>>>
>>> which seems to be essential and I can't find any obvious way to handle
>>> this.
>>> Am I missing something obvious here?
>>>
>>> [1]
>>>
>>> https://docs.oracle.com/javase/7/docs/api/java/util/concurrent/BlockingQueue.html
>>>
>>>
>>> Tim
>>
>>
>>
>>
>>
>> -----
>> Ben O'Day
>> IT Consultant -http://consulting-notes.com
>>
>> --
>> View this message in context:
>> http://camel.465427.n5.nabble.com/general-approach-to-streaming-tp5759483p5759732.html
>> Sent from the Camel - Users mailing list archive at Nabble.com.
>
>



-- 
Claus Ibsen
-----------------
Red Hat, Inc.
Email: cibsen@redhat.com
Twitter: davsclaus
Blog: http://davsclaus.com
Author of Camel in Action: http://www.manning.com/ibsen
hawtio: http://hawt.io/
fabric8: http://fabric8.io/

Mime
View raw message