hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Jungblut (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-367) Runtime Compression of BSP Messages to Improve the Performance
Date Tue, 21 Feb 2012 20:06:49 GMT

    [ https://issues.apache.org/jira/browse/HAMA-367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13212860#comment-13212860
] 

Thomas Jungblut commented on HAMA-367:
--------------------------------------

Thanks for your contribution Apurv, you saved us a lot of time and nerves.

Just committed it. 

bq. would return a null and no compressor would be created.

In any way (but the case where the default compressor is not found in classpath) it returns
the default compressor. In our case this is snappy.
It has a good tradeoff between amount of compression and time to compress. So there should
be no problem.

Great we can now close this! -> Fixed!
                
> Runtime Compression of BSP Messages to Improve the Performance
> --------------------------------------------------------------
>
>                 Key: HAMA-367
>                 URL: https://issues.apache.org/jira/browse/HAMA-367
>             Project: Hama
>          Issue Type: New Feature
>          Components: bsp, documentation 
>    Affects Versions: 0.4.0
>            Reporter: Edward J. Yoon
>            Assignee: Apurv Verma
>              Labels: gsoc, gsoc2011, mentor
>             Fix For: 0.5.0
>
>         Attachments: HAMA-367.patch, HAMA-367.patch, HAMA-367.patch, HAMA-367_2.patch,
test_files.tar.gz
>
>   Original Estimate: 2,016h
>  Remaining Estimate: 2,016h
>
> As you know, the exchanging data between processes, is a core part of whole performance
in Bulk Synchronous Parallel.
> In this research, we investigate BSP message data compression in the context of large-scale
distributed message-passing systems to reduce the communication time of individual messages
and to improve the bandwidth of the overall system. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message