apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sandesh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (APEXCORE-467) BufferServer should not be deployed in the containers with only Output operators
Date Tue, 24 May 2016 20:54:12 GMT

    [ https://issues.apache.org/jira/browse/APEXCORE-467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15298888#comment-15298888
] 

Sandesh commented on APEXCORE-467:
----------------------------------

[~pramod.immaneni]

I tried to make the BufferServer start on-demand when any operator needs to send tuples to
different containers (even during dynamic partitioning), but It required a lot of changes.

Also looking at the Buffer Server code, it allocates most of the resources(DataList) only
when there is Publish/Subscribe request, so not much resource are wasted to keep it running.
Another point, there is a Jira to allow users to bypass bufferserver, so for this jira "won't
fix".

> BufferServer should not be deployed in the containers with only Output operators
> --------------------------------------------------------------------------------
>
>                 Key: APEXCORE-467
>                 URL: https://issues.apache.org/jira/browse/APEXCORE-467
>             Project: Apache Apex Core
>          Issue Type: Improvement
>            Reporter: Sandesh
>            Assignee: Sandesh
>
> BufferServer is started in all the streaming containers, but it is not required in all
the containers. 
> For example, Containers with only Output operators or the containers with output ports
which are not connected to ports outside the containers don't need BufferServer.
> During the operator deployment, it is assumed that BufferServer is already started in
every container, that needs to be changed to address this issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message