incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon (JIRA)" <>
Subject [jira] [Commented] (HAMA-380) Send messages in batches to reduce RPC overhead.
Date Wed, 20 Apr 2011 05:05:05 GMT


Edward J. Yoon commented on HAMA-380:

Plus, is there a way to avoid unchecked cast warning?

Below code seems OK.
Class<?> clazz = null;

BSPMessage msg = (BSPMessage) ReflectionUtils.newInstance(clazz, null);

> Send messages in batches to reduce RPC overhead.
> ------------------------------------------------
>                 Key: HAMA-380
>                 URL:
>             Project: Hama
>          Issue Type: Improvement
>          Components: bsp
>    Affects Versions: 0.3.0
>            Reporter: Miklos Erdelyi
>            Assignee: Miklos Erdelyi
>             Fix For: 0.3.0
>         Attachments: HAMA-380-v2.patch, bspmsgbundle.patch, bspmsgbundle.v2.patch
>   Original Estimate: 4h
>  Remaining Estimate: 4h
> When profiling graph computations running on HAMA it turned out that huge amount of time
is spent in RPC calls.
> To reduce this overhead I propose extending the GroomServer's API with a put(BSPMessageBundle)
method so that a group of messages can be transferred from the caller to the callee at once.
Also, the sync() operation should be improved by sending messages in batches rather than one-by-one.
> Using BSPMessageBundle makes it easier to add support for compression of messages later.

This message is automatically generated by JIRA.
For more information on JIRA, see:

View raw message