hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HAMA-955) Support UnsafeByteArrayInputStream and UnSafeByteArrayOutputStream
Date Thu, 28 May 2015 02:28:17 GMT

     [ https://issues.apache.org/jira/browse/HAMA-955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Edward J. Yoon updated HAMA-955:
--------------------------------
    Attachment: HAMA-955_v05.patch

As you already might know, workers manage Vertex objects in serialized form to reduce the
memory usage and the strain on the garbage collector.

So, a lot of serialization and deserialization is needed for processing vertices at every
iteration. Here is the target point and this patch changes them. 

Please review and if you're fine, let's commit it.

> Support UnsafeByteArrayInputStream and UnSafeByteArrayOutputStream
> ------------------------------------------------------------------
>
>                 Key: HAMA-955
>                 URL: https://issues.apache.org/jira/browse/HAMA-955
>             Project: Hama
>          Issue Type: Task
>          Components: bsp core
>    Affects Versions: 0.7.0
>            Reporter: Minho Kim
>            Assignee: Minho Kim
>         Attachments: HAMA-955.patch, HAMA-955_v05.patch, HAMA-955_v1.patch, HAMA-955_v2.patch,
HAMA-955_v3.patch, HAMA-955_v4.patch
>
>
> You'll be able to use UnsafeByteArrayInput and Output Stream.
> Although it is not safe, it can give you more faster performance than java.io.ByteArrayInput(Output)Stream.
> If you need to run more faster job, you can use this through setting Hama configuration.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message