apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pramod Immaneni (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (APEXCORE-745) Buffer server may stop processing tuples when backpressure is enabled
Date Fri, 30 Jun 2017 23:29:00 GMT

     [ https://issues.apache.org/jira/browse/APEXCORE-745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Pramod Immaneni resolved APEXCORE-745.
       Resolution: Fixed
    Fix Version/s: 3.7.0

> Buffer server may stop processing tuples when backpressure is enabled
> ---------------------------------------------------------------------
>                 Key: APEXCORE-745
>                 URL: https://issues.apache.org/jira/browse/APEXCORE-745
>             Project: Apache Apex Core
>          Issue Type: Bug
>          Components: Buffer Server
>    Affects Versions: 3.6.0
>            Reporter: Vlad Rozov
>            Assignee: Vlad Rozov
>            Priority: Critical
>             Fix For: 3.7.0
> When backpressure is enabled, blocks released by a publisher are not evicted. This may
lead to a condition (for example when there is a delay between publisher and subscribers request)
where the publisher publishes all data blocks that the buffer server is allowed to allocate
before subscribers submit subscription requests. It leads to the publisher being blocked,
so it does not accept any new data and does not notify subscribers that the new data is available.
At the same time subscribers are not scheduled to run after they catchup (or exit catchup),
so the publisher will be blocked indefinitely. Restarting the downstream container (due to,
for example, blocked downstream operator) repeat the same sequence and does not help.

This message was sent by Atlassian JIRA

View raw message