Mailing-List: contact hama-dev-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hama-dev@incubator.apache.org
Date: Mon, 13 Feb 2012 11:29:01 +0000 (UTC)
From: "Apurv Verma (Commented) (JIRA)" <jira@apache.org>
To: hama-dev@incubator.apache.org
Message-ID: 
 <1728927742.31367.1329132541121.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: 
 <628242470.5667.1300237049576.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Commented] (HAMA-367) Runtime Compression of BSP Messages
 to Improve the Performance
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HAMA-367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13206813#comment-13206813 ] 

Apurv Verma commented on HAMA-367:
----------------------------------

Please suggest what would be better as the next step
1) A compressor decompressor interface like in hadoop or
2) A simple factory class that does a reflection based instantiation of the compression input/output stream classes which would be given in the configuration.

So the user would need to put these properties in the conf files. 

hama.bsp.message.compressioninputstream & hama.bsp.message.compressionoutputstream

The values of these properties would be the fully classified name for the compression input/output stream classes.
                
> Runtime Compression of BSP Messages to Improve the Performance
> --------------------------------------------------------------
>
>                 Key: HAMA-367
>                 URL: https://issues.apache.org/jira/browse/HAMA-367
>             Project: Hama
>          Issue Type: New Feature
>          Components: bsp, documentation 
>    Affects Versions: 0.4.0
>            Reporter: Edward J. Yoon
>            Assignee: Apurv Verma
>              Labels: gsoc, gsoc2011, mentor
>             Fix For: 0.5.0
>
>         Attachments: HAMA-367.patch, HAMA-367.patch, HAMA-367.patch, test_files.tar.gz
>
>   Original Estimate: 2,016h
>  Remaining Estimate: 2,016h
>
> As you know, the exchanging data between processes, is a core part of whole performance in Bulk Synchronous Parallel.
> In this research, we investigate BSP message data compression in the context of large-scale distributed message-passing systems to reduce the communication time of individual messages and to improve the bandwidth of the overall system. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira