tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rohini Palaniswamy (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (TEZ-3140) Reduce AM memory usage while serialization
Date Mon, 29 Feb 2016 15:56:18 GMT

     [ https://issues.apache.org/jira/browse/TEZ-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Rohini Palaniswamy updated TEZ-3140:
------------------------------------
    Attachment: TEZ-3140-2.patch

Updated patch addressing review comments from [~sseth].  

Did not switch to DataInputByteBuffer to avoid the unnecessary objects it creates. There are
couple more in DataInputByteBuffer.Buffer class (scratch, buffers, bidx, pos, length) apart
from ones in DataInputStream mentioned by Jon. Though the sizes are negligible, decided to
stick with the wrapper class in the patch as that has zero object and size additional overhead.


> Reduce AM memory usage while serialization
> ------------------------------------------
>
>                 Key: TEZ-3140
>                 URL: https://issues.apache.org/jira/browse/TEZ-3140
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
>             Fix For: 0.7.1, 0.8.3
>
>         Attachments: TEZ-3140-1.patch, TEZ-3140-2.patch
>
>
>    There is an unnecessary copy of userpayload byte array during serialization.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message