camel-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Evgeny Minkevich (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CAMEL-11262) camel-google-pubsub - Improve to work with streaming mode
Date Fri, 19 May 2017 10:22:05 GMT

    [ https://issues.apache.org/jira/browse/CAMEL-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16017191#comment-16017191
] 

Evgeny Minkevich commented on CAMEL-11262:
------------------------------------------

A few use cases that need to be considered when switching to async.

1. Downstream blocking queues (such as seda limited to let's say 100 with explicit blocking
until processed)

The use case here was when PubSub is under load, Camel had tendency to extract messages first
leading to reading the queue all the time and not processing the downstream.

2. throttle

One of the use cases - how would this play out with async?

3. explicit concurrentConsumers

I have noticed a slight performance degradation with a large number of concurrent consumers
against PubSub - but mainly concerned with downstream systems

Important discussions to consider:

https://github.com/GoogleCloudPlatform/google-cloud-java/issues/1661
https://github.com/GoogleCloudPlatform/google-cloud-java/issues/1157

As you can see synchronous pull has been requested by more than one person.
>From my perspective, the improvements to be introduced would need to extend the current
model.

> camel-google-pubsub - Improve to work with streaming mode
> ---------------------------------------------------------
>
>                 Key: CAMEL-11262
>                 URL: https://issues.apache.org/jira/browse/CAMEL-11262
>             Project: Camel
>          Issue Type: Improvement
>          Components: camel-google-pubsub
>    Affects Versions: 2.19.0
>            Reporter: Claus Ibsen
>             Fix For: 2.20.0
>
>
> The pubsub component
> https://github.com/apache/camel/tree/master/components/camel-google-pubsub
> Can likely be improved to work better with streaming mode and use Camel asynchronous
processing. 
> There may be other things.
> Ray Tsang from Google has some ideas and want to help out.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message