incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apurv Verma (Commented) (JIRA)" <>
Subject [jira] [Commented] (HAMA-367) Runtime Compression of BSP Messages to Improve the Performance
Date Mon, 13 Feb 2012 11:29:01 GMT


Apurv Verma commented on HAMA-367:

Please suggest what would be better as the next step
1) A compressor decompressor interface like in hadoop or
2) A simple factory class that does a reflection based instantiation of the compression input/output
stream classes which would be given in the configuration.

So the user would need to put these properties in the conf files. 

hama.bsp.message.compressioninputstream & hama.bsp.message.compressionoutputstream

The values of these properties would be the fully classified name for the compression input/output
stream classes.
> Runtime Compression of BSP Messages to Improve the Performance
> --------------------------------------------------------------
>                 Key: HAMA-367
>                 URL:
>             Project: Hama
>          Issue Type: New Feature
>          Components: bsp, documentation 
>    Affects Versions: 0.4.0
>            Reporter: Edward J. Yoon
>            Assignee: Apurv Verma
>              Labels: gsoc, gsoc2011, mentor
>             Fix For: 0.5.0
>         Attachments: HAMA-367.patch, HAMA-367.patch, HAMA-367.patch, test_files.tar.gz
>   Original Estimate: 2,016h
>  Remaining Estimate: 2,016h
> As you know, the exchanging data between processes, is a core part of whole performance
in Bulk Synchronous Parallel.
> In this research, we investigate BSP message data compression in the context of large-scale
distributed message-passing systems to reduce the communication time of individual messages
and to improve the bandwidth of the overall system. 

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


View raw message