incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashish Agarwal (JIRA)" <>
Subject [jira] [Commented] (HAMA-367) Runtime Compression of BSP Messages to Improve the Performance
Date Sat, 02 Apr 2011 03:29:05 GMT


Ashish Agarwal commented on HAMA-367:


I did some research 
- looked at the paper above 
- read chapter 1 of the book Parallel Scientific Computing - A structured approach ... by
- looked at the paper "Adaptive-Compi: Enhancing Mpi-Based Applications’ Performance and
Scalability by using Adaptive Compression"

and some online tutorials about MPI.

In the project, we would be looking at two areas -

1. Study different compression algorithms and implement the ones that are able to exploit
the unique characteristics of MPI messages.

2. Develop an adaptive compression algorithm - where we could first identify the datatype
of the file that is to be compressed and then use the appropriate compression. 


> Runtime Compression of BSP Messages to Improve the Performance
> --------------------------------------------------------------
>                 Key: HAMA-367
>                 URL:
>             Project: Hama
>          Issue Type: New Feature
>          Components: bsp, documentation 
>    Affects Versions: 0.3.0
>            Reporter: Edward J. Yoon
>              Labels: gsoc, gsoc2011, mentor
>             Fix For: 0.3.0
>   Original Estimate: 2016h
>  Remaining Estimate: 2016h
> As you know, the exchanging data between processes, is a core part of whole performance
in Bulk Synchronous Parallel.
> In this research, we investigate BSP message data compression in the context of large-scale
distributed message-passing systems to reduce the communication time of individual messages
and to improve the bandwidth of the overall system. 

This message is automatically generated by JIRA.
For more information on JIRA, see:

View raw message