incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashish Agarwal (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-367) Runtime Compression of BSP Messages to Improve the Performance
Date Sat, 04 Jun 2011 08:50:47 GMT

    [ https://issues.apache.org/jira/browse/HAMA-367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044236#comment-13044236
] 

Ashish Agarwal commented on HAMA-367:
-------------------------------------

I added a couple of functions to BSPPeer.java - one to compress and one to decompress using
the bzip2 compression.

The compressed file will be created on the local disk.

I'm calling the function just before adding the message to bundle

           for (BSPMessage message : messages) {
              	  compress(message, "compressedFile.txt");
    	      	  bundle.addMessage(message);

Then I added a breakpoint at the above line and then tried running PIEstimator. But somehow,
the program does not stop at the point. Why does it not stop ?

Also when we add the message in the addMessage function, do I change it so that the input
parameter is String compressedFilename and not BSPMessage message ?






> Runtime Compression of BSP Messages to Improve the Performance
> --------------------------------------------------------------
>
>                 Key: HAMA-367
>                 URL: https://issues.apache.org/jira/browse/HAMA-367
>             Project: Hama
>          Issue Type: New Feature
>          Components: bsp, documentation 
>    Affects Versions: 0.3.0
>            Reporter: Edward J. Yoon
>            Assignee: Edward J. Yoon
>              Labels: gsoc, gsoc2011, mentor
>             Fix For: 0.3.0
>
>         Attachments: test_files.tar.gz
>
>   Original Estimate: 2016h
>  Remaining Estimate: 2016h
>
> As you know, the exchanging data between processes, is a core part of whole performance
in Bulk Synchronous Parallel.
> In this research, we investigate BSP message data compression in the context of large-scale
distributed message-passing systems to reduce the communication time of individual messages
and to improve the bandwidth of the overall system. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message