hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-645) Compression Threshold
Date Sat, 22 Sep 2012 23:35:07 GMT

    [ https://issues.apache.org/jira/browse/HAMA-645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13461291#comment-13461291
] 

Edward J. Yoon commented on HAMA-645:
-------------------------------------

{code}
   <property>
    <name>hama.messenger.compression.class</name>
    <value>org.apache.hama.bsp.message.compress.Bzip2Compressor</value>
    <description>The message compression algorithm to choose.</description>
  </property>
  <property>
    <name>hama.messenger.compression.threshold</name>
    <value>1048576</value>
    <description>The Compressor threshold sets the level at which compression begins.</description>
  </property>
{code}

And add client API so that user can set compression threshold per job. 

{code}
setCompressionThreshold(int ct) // Set compression threshold in bytes.
{code}
                
> Compression Threshold
> ---------------------
>
>                 Key: HAMA-645
>                 URL: https://issues.apache.org/jira/browse/HAMA-645
>             Project: Hama
>          Issue Type: Improvement
>          Components: bsp core
>    Affects Versions: 0.5.0
>            Reporter: Edward J. Yoon
>            Assignee: Edward J. Yoon
>             Fix For: 0.6.0
>
>
> I don't see much advantage to compression for small message bundles.
> Compress only when message bundle is larger than threshold.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message