incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apurv Verma <dapu...@gmail.com>
Subject Re: [jira] [Commented] (HAMA-367) Runtime Compression of BSP Messages to Improve the Performance
Date Sat, 28 Jan 2012 14:42:13 GMT
I am sorry, I am doing the add now and submitting the new patch.
Yes, getCompressionRatio() just compares the byte length.

I observed that for small message bundles the compressed length may be
greater than the original uncompressed length therefore I added this case.

--
thanks and regards,

Apurv Verma
B. Tech.(CSE)
IIT- Ropar






On Sat, Jan 28, 2012 at 4:47 PM, Thomas Jungblut (Commented) (JIRA) <
jira@apache.org> wrote:

>
>    [
> https://issues.apache.org/jira/browse/HAMA-367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13195488#comment-13195488]
>
> Thomas Jungblut commented on HAMA-367:
> --------------------------------------
>
> Looks good to me, was it that easy? However it seems that you haven't
> included the "BSPCompressedBundle".
>
> You can make "svn stat" on the project root and see what you haven't
> included yet, it has a question mark on the left.
> Then you can call "svn add <the file or dir>" and diff the patch again.
>
> It would be nice if you can include this before I start to test this.
>
> How expensive is "BSPMessageCompressor.getCompressionRatio()"?
> Does it just compare the byte[] length?
>
> > Runtime Compression of BSP Messages to Improve the Performance
> > --------------------------------------------------------------
> >
> >                 Key: HAMA-367
> >                 URL: https://issues.apache.org/jira/browse/HAMA-367
> >             Project: Hama
> >          Issue Type: New Feature
> >          Components: bsp, documentation
> >    Affects Versions: 0.4.0
> >            Reporter: Edward J. Yoon
> >              Labels: gsoc, gsoc2011, mentor
> >         Attachments: HAMA-367.patch, test_files.tar.gz
> >
> >   Original Estimate: 2,016h
> >  Remaining Estimate: 2,016h
> >
> > As you know, the exchanging data between processes, is a core part of
> whole performance in Bulk Synchronous Parallel.
> > In this research, we investigate BSP message data compression in the
> context of large-scale distributed message-passing systems to reduce the
> communication time of individual messages and to improve the bandwidth of
> the overall system.
>
> --
> This message is automatically generated by JIRA.
> If you think it was sent incorrectly, please contact your JIRA
> administrators:
> https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
> For more information on JIRA, see: http://www.atlassian.com/software/jira
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message