apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "David Yan (JIRA)" <j...@apache.org>
Subject [jira] [Created] (APEXCORE-313) BufferServer not purged correctly in StramLocalCluster
Date Sat, 23 Jan 2016 22:28:39 GMT
David Yan created APEXCORE-313:
----------------------------------

             Summary: BufferServer not purged correctly in StramLocalCluster 
                 Key: APEXCORE-313
                 URL: https://issues.apache.org/jira/browse/APEXCORE-313
             Project: Apache Apex Core
          Issue Type: Bug
            Reporter: David Yan


When an operator dies, the output data for that operator in buffer server should be invalidated.
 Currently it's not and unless we do this: 
{code}
localCluster.setPerContainerBufferServer(true);
{code}
it's possible for a newly recovered operator to get the ghost data from an upstream operator
in the same checkpoint group that is still in the process of recovering.  When the upstream
operator finally recovers, it tries to send the data from the recovery checkpoint that is
duplicate of the ghost data, thus putting the whole thing in a bad state.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message