apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sandesh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (APEXCORE-467) BufferServer should not be deployed in the containers with only Output operators
Date Tue, 24 May 2016 20:54:12 GMT

    [ https://issues.apache.org/jira/browse/APEXCORE-467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15298888#comment-15298888

Sandesh commented on APEXCORE-467:


I tried to make the BufferServer start on-demand when any operator needs to send tuples to
different containers (even during dynamic partitioning), but It required a lot of changes.

Also looking at the Buffer Server code, it allocates most of the resources(DataList) only
when there is Publish/Subscribe request, so not much resource are wasted to keep it running.
Another point, there is a Jira to allow users to bypass bufferserver, so for this jira "won't

> BufferServer should not be deployed in the containers with only Output operators
> --------------------------------------------------------------------------------
>                 Key: APEXCORE-467
>                 URL: https://issues.apache.org/jira/browse/APEXCORE-467
>             Project: Apache Apex Core
>          Issue Type: Improvement
>            Reporter: Sandesh
>            Assignee: Sandesh
> BufferServer is started in all the streaming containers, but it is not required in all
the containers. 
> For example, Containers with only Output operators or the containers with output ports
which are not connected to ports outside the containers don't need BufferServer.
> During the operator deployment, it is assumed that BufferServer is already started in
every container, that needs to be changed to address this issue.

This message was sent by Atlassian JIRA

View raw message