incubator-s4-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthieu Morel (Created) (JIRA)" <j...@apache.org>
Subject [jira] [Created] (S4-40) Checkpointing: offload serialization of PEs from the event processing thread
Date Thu, 12 Jan 2012 12:59:39 GMT
Checkpointing: offload serialization of PEs from the event processing thread
----------------------------------------------------------------------------

                 Key: S4-40
                 URL: https://issues.apache.org/jira/browse/S4-40
             Project: Apache S4
          Issue Type: Improvement
    Affects Versions: 0.4
            Reporter: Matthieu Morel
            Assignee: Matthieu Morel
             Fix For: 0.4


Checkpointing preserves PE state by serializing PE data then storing the serialized data on
stable storage.

Currently, the storage operation is asynchronous, but the serialization of PEs is performed
by the event processing thread. Some PEs have complex data structures that take time to serialize,
adding latency to event processing. This affects the overall response time and can also lead
to queues overflows and event loss.

Therefore, we must perform the serialization asynchronously, and make sure to prevent any
race condition (PE data updated by normal event processing while PE being serialized on another
thread).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message