incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Jungblut (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-367) Runtime Compression of BSP Messages to Improve the Performance
Date Sat, 28 Jan 2012 17:57:10 GMT

    [ https://issues.apache.org/jira/browse/HAMA-367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13195584#comment-13195584
] 

Thomas Jungblut commented on HAMA-367:
--------------------------------------

Good work! With snappy it seems to work for me. 
However, we would like to have multiple compressors and a user defines this via configuration.

So I guess we need a compressor/decompressor interface and the typical reflection based class
instantiation. But I think we just make a follow-up issue for this.

Another thing would be testcases, you should include one ;)

Did you use the code formatter (http://incubator.apache.org/hama/hama-eclipse-formatter.xml)?
I think there might be tabs instead of 3 spaces. 
                
> Runtime Compression of BSP Messages to Improve the Performance
> --------------------------------------------------------------
>
>                 Key: HAMA-367
>                 URL: https://issues.apache.org/jira/browse/HAMA-367
>             Project: Hama
>          Issue Type: New Feature
>          Components: bsp, documentation 
>    Affects Versions: 0.4.0
>            Reporter: Edward J. Yoon
>              Labels: gsoc, gsoc2011, mentor
>         Attachments: HAMA-367.patch, HAMA-367.patch, test_files.tar.gz
>
>   Original Estimate: 2,016h
>  Remaining Estimate: 2,016h
>
> As you know, the exchanging data between processes, is a core part of whole performance
in Bulk Synchronous Parallel.
> In this research, we investigate BSP message data compression in the context of large-scale
distributed message-passing systems to reduce the communication time of individual messages
and to improve the bandwidth of the overall system. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message