Return-Path: X-Original-To: apmail-incubator-hama-dev-archive@minotaur.apache.org Delivered-To: apmail-incubator-hama-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 915AF95C4 for ; Sat, 28 Jan 2012 14:43:01 +0000 (UTC) Received: (qmail 32678 invoked by uid 500); 28 Jan 2012 14:43:01 -0000 Delivered-To: apmail-incubator-hama-dev-archive@incubator.apache.org Received: (qmail 32609 invoked by uid 500); 28 Jan 2012 14:43:00 -0000 Mailing-List: contact hama-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hama-dev@incubator.apache.org Delivered-To: mailing list hama-dev@incubator.apache.org Received: (qmail 32601 invoked by uid 99); 28 Jan 2012 14:43:00 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 28 Jan 2012 14:43:00 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of dapurv5@gmail.com designates 209.85.214.175 as permitted sender) Received: from [209.85.214.175] (HELO mail-tul01m020-f175.google.com) (209.85.214.175) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 28 Jan 2012 14:42:54 +0000 Received: by obbuo9 with SMTP id uo9so2961604obb.6 for ; Sat, 28 Jan 2012 06:42:33 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=ewR7N+ffH+qa9n8tEViR7XqAZSzXmrwXCdGgFIZWzeQ=; b=dXW++NsasNr0dKj7iGj3s8qMTGxQucWP1QXxZ3AspK8jA/feKER1CK8mDS9vS9Chh0 i6Yw/gJnYNQfvB1uxcUeTRt/lvdqi4lSQGgzBUIgVNXYCUTfiv/Qwfuh4b8OP0HAGouO 7k04UPEKMvLZ8pn31fd7H4Bm/kcKQYIUJNpSk= Received: by 10.182.7.42 with SMTP id g10mr11317207oba.7.1327761753225; Sat, 28 Jan 2012 06:42:33 -0800 (PST) MIME-Version: 1.0 Received: by 10.182.69.233 with HTTP; Sat, 28 Jan 2012 06:42:13 -0800 (PST) In-Reply-To: <1618417705.4047.1327749430298.JavaMail.tomcat@hel.zones.apache.org> References: <628242470.5667.1300237049576.JavaMail.tomcat@hel.zones.apache.org> <1618417705.4047.1327749430298.JavaMail.tomcat@hel.zones.apache.org> From: Apurv Verma Date: Sat, 28 Jan 2012 20:12:13 +0530 Message-ID: Subject: Re: [jira] [Commented] (HAMA-367) Runtime Compression of BSP Messages to Improve the Performance To: hama-dev@incubator.apache.org Content-Type: multipart/alternative; boundary=f46d04446943a5ba9f04b7979ff5 X-Virus-Checked: Checked by ClamAV on apache.org --f46d04446943a5ba9f04b7979ff5 Content-Type: text/plain; charset=ISO-8859-1 I am sorry, I am doing the add now and submitting the new patch. Yes, getCompressionRatio() just compares the byte length. I observed that for small message bundles the compressed length may be greater than the original uncompressed length therefore I added this case. -- thanks and regards, Apurv Verma B. Tech.(CSE) IIT- Ropar On Sat, Jan 28, 2012 at 4:47 PM, Thomas Jungblut (Commented) (JIRA) < jira@apache.org> wrote: > > [ > https://issues.apache.org/jira/browse/HAMA-367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13195488#comment-13195488] > > Thomas Jungblut commented on HAMA-367: > -------------------------------------- > > Looks good to me, was it that easy? However it seems that you haven't > included the "BSPCompressedBundle". > > You can make "svn stat" on the project root and see what you haven't > included yet, it has a question mark on the left. > Then you can call "svn add " and diff the patch again. > > It would be nice if you can include this before I start to test this. > > How expensive is "BSPMessageCompressor.getCompressionRatio()"? > Does it just compare the byte[] length? > > > Runtime Compression of BSP Messages to Improve the Performance > > -------------------------------------------------------------- > > > > Key: HAMA-367 > > URL: https://issues.apache.org/jira/browse/HAMA-367 > > Project: Hama > > Issue Type: New Feature > > Components: bsp, documentation > > Affects Versions: 0.4.0 > > Reporter: Edward J. Yoon > > Labels: gsoc, gsoc2011, mentor > > Attachments: HAMA-367.patch, test_files.tar.gz > > > > Original Estimate: 2,016h > > Remaining Estimate: 2,016h > > > > As you know, the exchanging data between processes, is a core part of > whole performance in Bulk Synchronous Parallel. > > In this research, we investigate BSP message data compression in the > context of large-scale distributed message-passing systems to reduce the > communication time of individual messages and to improve the bandwidth of > the overall system. > > -- > This message is automatically generated by JIRA. > If you think it was sent incorrectly, please contact your JIRA > administrators: > https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa > For more information on JIRA, see: http://www.atlassian.com/software/jira > > > --f46d04446943a5ba9f04b7979ff5--