apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vlad Rozov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (APEXCORE-353) Buffer server may stop processing data
Date Wed, 24 Feb 2016 04:58:18 GMT

    [ https://issues.apache.org/jira/browse/APEXCORE-353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15160181#comment-15160181
] 

Vlad Rozov commented on APEXCORE-353:
-------------------------------------

Buffer server has single threaded execution service that is responsible for processing data
on all datalists. This thread iterates over datalist and submits data to netlet to be sent
downstream. In case downstream operator (or unifier) is not capable of keeping up with incoming
stream of data, this thread will be blocked re-trying to send data to the downstream operator,
so data in other datalists/output streams will be waiting for the thread to become available.
In case downstream operator waits for that data (for example it may wait for BEGIN or END
window) before continuing with processing data on the initial stream (the one that currently
is served by the thread), bufferserver will completely stop sending data to downstream operators.

> Buffer server may stop processing data
> --------------------------------------
>
>                 Key: APEXCORE-353
>                 URL: https://issues.apache.org/jira/browse/APEXCORE-353
>             Project: Apache Apex Core
>          Issue Type: Bug
>    Affects Versions: 3.2.0, 3.3.0, 3.4.0, 3.3.1
>            Reporter: Vlad Rozov
>            Assignee: Vlad Rozov
>
> When an operator has two or more output ports and one of output ports produces large
number of tuples, the bufferserver may stop sending data to downstream operators.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message