apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pramod Immaneni (JIRA)" <j...@apache.org>
Subject [jira] [Created] (APEXCORE-684) Back pressure can create a bursty flow in the input operators and increased window duration for some windows and short for others
Date Mon, 27 Mar 2017 17:24:41 GMT
Pramod Immaneni created APEXCORE-684:
----------------------------------------

             Summary: Back pressure can create a bursty flow in the input operators and increased
window duration for some windows and short for others
                 Key: APEXCORE-684
                 URL: https://issues.apache.org/jira/browse/APEXCORE-684
             Project: Apache Apex Core
          Issue Type: Improvement
            Reporter: Pramod Immaneni
            Assignee: Pramod Immaneni


In an application where the processing rate of downstream operators is slower than the input
operator consumption rate, back pressure will kick in and eventually propagate to the input
operator. This will block the input operator till there is space available in the buffers
and consequently block the window and increase the window duration for some windows and reduce
it significantly for others. If the backpressure feedback can potentially be used by the engine
to slow down the scheduling of data emission from input operator, a.k.a call to emitTuples
method in input operator, it can lead to much more uniform and steady behavior.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message