hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HAMA-870) Refactor runtime message compression
Date Wed, 12 Feb 2014 06:27:28 GMT
Edward J. Yoon created HAMA-870:

             Summary: Refactor runtime message compression
                 Key: HAMA-870
                 URL: https://issues.apache.org/jira/browse/HAMA-870
             Project: Hama
          Issue Type: Improvement
          Components: bsp core
    Affects Versions: 0.6.3
            Reporter: Edward J. Yoon
            Assignee: Edward J. Yoon
             Fix For: 0.7.0

Original compression flow was like below:

1) Bundles messages in outgoing queue
2) Serializes bundle object to byte array
3) Compresses byte array to new byte array
4) Creates BSPCompressedBundle object for RPC communication

So, it was extremely slow!

Since BSPMessageBundle handles messages in byte array now, we can runtime compress the messages
during bundling. 

We don't need BSPCompressedBundle class anymore.

This message was sent by Atlassian JIRA

View raw message