incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Jungblut (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-358) Evaluation of Hama BSP communication protocol performance
Date Tue, 26 Apr 2011 07:20:03 GMT

    [ https://issues.apache.org/jira/browse/HAMA-358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13025104#comment-13025104
] 

Thomas Jungblut commented on HAMA-358:
--------------------------------------

So Zubair, you wasn't picked. Are you although going to evaluate it?

I recently recognized that Hadoop RPC wasn't really fast. It is used at startup when the datanodes
sending the blocks to the namenode. It takes 20 minutes for arround 2mio files on 6 nodes.
That is really slow.

> Evaluation of Hama BSP communication protocol performance
> ---------------------------------------------------------
>
>                 Key: HAMA-358
>                 URL: https://issues.apache.org/jira/browse/HAMA-358
>             Project: Hama
>          Issue Type: Improvement
>          Components: bsp, documentation 
>    Affects Versions: 0.2.0
>            Reporter: Edward J. Yoon
>              Labels: gsoc, gsoc2011, mentor
>             Fix For: 0.3.0
>
>   Original Estimate: 1008h
>  Remaining Estimate: 1008h
>
> The goal of this project is performance evaluation of RPC frameworks (e.g., Hadoop RPC,
Thrift, Google Protobuf, ..., etc) to figure out which is the best solution for Hama BSP communication.
Currently Hama is using Hadoop RPC to communicate and transfer messages between BSP workers.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message