hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suraj Menon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-664) Add bundle size estimator
Date Wed, 07 Nov 2012 20:25:11 GMT

    [ https://issues.apache.org/jira/browse/HAMA-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13492671#comment-13492671
] 

Suraj Menon commented on HAMA-664:
----------------------------------

Oh, I get what you are saying now. The only way to do that would be or rather should be from
0.7 is that addMessage writes messages to byte array instead of linked list. I don't think
we need to do that in 0.6.
                
> Add bundle size estimator
> -------------------------
>
>                 Key: HAMA-664
>                 URL: https://issues.apache.org/jira/browse/HAMA-664
>             Project: Hama
>          Issue Type: Improvement
>          Components: bsp core
>            Reporter: Edward J. Yoon
>            Assignee: Edward J. Yoon
>             Fix For: 0.6.0
>
>         Attachments: patch.txt
>
>
> I noticed that calculation of bundle object size in Avro RPC and Hadoop RPC causes significant
performance decrease and uses huge resources.
> We should get rid of this and figure out another way to convert byte array.
> {code}
>       ByteArrayOutputStream outArray = new ByteArrayOutputStream();
>       DataOutputStream out = new DataOutputStream(outArray);
>       msg.write(out);
>       out.close();
>       byte[] byteArray = outArray.toByteArray();
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message