tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Eagles (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (TEZ-3140) Reduce AM memory usage while serialization
Date Fri, 26 Feb 2016 22:08:18 GMT

    [ https://issues.apache.org/jira/browse/TEZ-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15169940#comment-15169940
] 

Jonathan Eagles commented on TEZ-3140:
--------------------------------------

The DataInputByteBuffer extends DataInputStream which has these nasty hidden buffers. That's
why this class needs to be avoided.
{noformat}
private byte bytearr[] = new byte[80];
private char chararr[] = new char[80];
{noformat}

> Reduce AM memory usage while serialization
> ------------------------------------------
>
>                 Key: TEZ-3140
>                 URL: https://issues.apache.org/jira/browse/TEZ-3140
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
>             Fix For: 0.7.1, 0.8.3
>
>         Attachments: TEZ-3140-1.patch
>
>
>    There is an unnecessary copy of userpayload byte array during serialization.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message