flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephan Ewen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-3387) Replace all ByteArrayOutputStream and DataOutputStream use in State Backends by DataOutputSerializer
Date Wed, 17 Feb 2016 14:01:18 GMT

    [ https://issues.apache.org/jira/browse/FLINK-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15150535#comment-15150535
] 

Stephan Ewen commented on FLINK-3387:
-------------------------------------

Nice, thanks for helping out with this.

I would start with replacing the deserialization from {{byte[]}} with {{DataInputDeserializer}}.
There should be only one instance of the {{DataInputDeserializer}}, which is always reused
by {{deserializer.setBuffer(bytes, 0, bytes.length)}}.


> Replace all ByteArrayOutputStream and DataOutputStream use in State Backends by DataOutputSerializer
> ----------------------------------------------------------------------------------------------------
>
>                 Key: FLINK-3387
>                 URL: https://issues.apache.org/jira/browse/FLINK-3387
>             Project: Flink
>          Issue Type: Bug
>          Components: state backends
>    Affects Versions: 1.0.0
>            Reporter: Stephan Ewen
>            Assignee: Subhobrata Dey
>
> Currently, the {{byte[]}} to object conversion and vice versa is always done by creating
new byte array streams and Data Input/Output streams. That is pretty wasteful, we can optimize
this with Flink's own classes:
>   - {{DataInputSerializer}}
>   - {{DataOutputSerializer}}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message