incubator-s4-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthieu Morel (Closed) (JIRA)" <j...@apache.org>
Subject [jira] [Closed] (S4-40) Checkpointing: offload serialization of PEs from the event processing thread
Date Tue, 31 Jan 2012 12:04:10 GMT

     [ https://issues.apache.org/jira/browse/S4-40?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Matthieu Morel closed S4-40.
----------------------------

    Resolution: Fixed

merged into dev branch http://git-wip-us.apache.org/repos/asf/incubator-s4/commit/29a22ef0
                
> Checkpointing: offload serialization of PEs from the event processing thread
> ----------------------------------------------------------------------------
>
>                 Key: S4-40
>                 URL: https://issues.apache.org/jira/browse/S4-40
>             Project: Apache S4
>          Issue Type: Improvement
>    Affects Versions: 0.4
>            Reporter: Matthieu Morel
>            Assignee: Matthieu Morel
>             Fix For: 0.4
>
>
> Checkpointing preserves PE state by serializing PE data then storing the serialized data
on stable storage.
> Currently, the storage operation is asynchronous, but the serialization of PEs is performed
by the event processing thread. Some PEs have complex data structures that take time to serialize,
adding latency to event processing. This affects the overall response time and can also lead
to queues overflows and event loss.
> Therefore, we must perform the serialization asynchronously, and make sure to prevent
any race condition (PE data updated by normal event processing while PE being serialized on
another thread).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message