hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon (JIRA)" <j...@apache.org>
Subject [jira] [Issue Comment Edited] (HAMA-367) Runtime Compression of BSP Messages to Improve the Performance
Date Mon, 28 Mar 2011 23:15:05 GMT

    [ https://issues.apache.org/jira/browse/HAMA-367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13012267#comment-13012267
] 

Edward J. Yoon edited comment on HAMA-367 at 3/28/11 11:14 PM:
---------------------------------------------------------------

Hi,

Here's very nice paper:

http://www.civ.cvut.cz/others/konference_supercomputing/Proceedings_SC_2004/schedule/pdfs/pap183.pdf

The goal of this project also is a "the compression algorithm that allows -cMPI- to make better
use of available network bandwidth, and several performance-enhancing optimizations."

As mentioned in paper, the use of *suitable compression algorithm for message data type* can
significantly affect the execute performance. 

First of all, you will need to design your own scenario. (1. Why) If you want to improve the
performance of exist examples (e.g., Pi Estimator), it's OK. and then, implement the compression.
(2. What/How) Finally, proof your work. (3. Benchmark and Conclusion)

Your code can be improved later. Don't waste your time to writing beautiful code. *The introduction,
development, turn and conclusion are important. :)


      was (Author: udanax):
    Hi,

Here's very nice paper:

http://www.civ.cvut.cz/others/konference_supercomputing/Proceedings_SC_2004/schedule/pdfs/pap183.pdf

The goal of this project also is a "the compression algorithm that allows -cMPI- to make better
use of available network bandwidth, and several performance-enhancing optimizations."

As mentioned in paper, the use of *suitable compression algorithm for message data type* can
significantly affect the system performance. 

First of all, you will need to design your own scenario. (1. Why) If you want to improve the
performance of exist examples (e.g., Pi Estimator), it's OK. and then, implement the compression.
(2. What/How) Finally, proof your work. (3. Benchmark and Conclusion)

Your code can be improved later. Don't waste your time to writing beautiful code. *The introduction,
development, turn and conclusion are important. :)

  
> Runtime Compression of BSP Messages to Improve the Performance
> --------------------------------------------------------------
>
>                 Key: HAMA-367
>                 URL: https://issues.apache.org/jira/browse/HAMA-367
>             Project: Hama
>          Issue Type: New Feature
>          Components: bsp, documentation 
>    Affects Versions: 0.3.0
>            Reporter: Edward J. Yoon
>              Labels: gsoc, gsoc2011, mentor
>             Fix For: 0.3.0
>
>   Original Estimate: 2016h
>  Remaining Estimate: 2016h
>
> As you know, the exchanging data between processes, is a core part of whole performance
in Bulk Synchronous Parallel.
> In this research, we investigate BSP message data compression in the context of large-scale
distributed message-passing systems to reduce the communication time of individual messages
and to improve the bandwidth of the overall system. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message