flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ufuk Celebi (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-3462) Add position and magic number checks to record (de)serializers
Date Mon, 22 Feb 2016 13:26:18 GMT
Ufuk Celebi created FLINK-3462:

             Summary: Add position and magic number checks to record (de)serializers
                 Key: FLINK-3462
                 URL: https://issues.apache.org/jira/browse/FLINK-3462
             Project: Flink
          Issue Type: Improvement
            Reporter: Ufuk Celebi

In order to improve the debugging experience in case of serialization errors, we can add further
sanity checks to the deserializers:

- Check expected position in buffer in order to ensure that record boundaries are not crossed
within a buffer or bytes left unconsumed.
- Add magic number to record serializer and deserializer in order to check byte corruption.
We currently only have this on a per buffer level.

We will be able to use these checks to improve the error messages.

This message was sent by Atlassian JIRA

View raw message