apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Weise (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (APEXCORE-570) Prevent upstream operators from getting too far ahead when downstream operators are slow
Date Wed, 02 Nov 2016 19:02:58 GMT

    [ https://issues.apache.org/jira/browse/APEXCORE-570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15630072#comment-15630072
] 

Thomas Weise commented on APEXCORE-570:
---------------------------------------

>From the JIRA description, this sounds like a combination of backpressure with configurable
limit on the queue. For the intra-process case the queue capacity can be set. For buffer server,
it will spill over to disk, hence the upstream operator will produce at the speed of spooling.
Are you thinking of a capacity limit here?


> Prevent upstream operators from getting too far ahead when downstream operators are slow
> ----------------------------------------------------------------------------------------
>
>                 Key: APEXCORE-570
>                 URL: https://issues.apache.org/jira/browse/APEXCORE-570
>             Project: Apache Apex Core
>          Issue Type: Improvement
>            Reporter: Pramod Immaneni
>            Assignee: Pramod Immaneni
>
> If the downstream operators are slower than upstream operators then the upstream operators
will get ahead and the gap can continue to increase. Provide an option to slow down or temporarily
pause the upstream operators when they get too far ahead.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message