hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hyunsik Choi (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HAMA-244) Consider more simplified BSP programming interface
Date Thu, 13 May 2010 13:50:45 GMT

    [ https://issues.apache.org/jira/browse/HAMA-244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12867134#action_12867134

Hyunsik Choi commented on HAMA-244:


As I mentioned in the above comment, BSPMaster is responsible to do the following:
 1. Maintaining groom server status.
 2. Controlling super steps in a cluster.
 3. Maintaining job progress information.
 4. Assigning tasks to groom servers.
 5. Scheduling Job
 6. Controlling fault. 
 7. Providing users with the cluster control interface.
 8. Disseminating execution class across groom servers. (newly added)

Among them, now I plan to implement 1,3,4, 5 and 8. For these works, I made only the Work
class (i.e., a dummy class for BSP computing) that has no method. A user needs to set only
the class to a simple job instance in order to submit a job. It is enough for me to implement
above features. Among above 5 features that I plan in HAMA-251, I already implemented most
features although they are simple and some of the classes are borrowed from MapReduce.

For instance, the 8th feature plays a role to copy both job's meta data submitted and a jar
file (containing an executable BSP class and its related classes) to a bsp master's disk from
clients's disk and then to copy the bsp.jar to all groom servers' disk. This way has used
in many cluster architectures, such as Condor, Clustera, and MapReduce.

I still don't know why HAMA-244 must be first. Do you mean that we have to solve issues in
the order that you determine?

> Consider more simplified BSP programming interface
> --------------------------------------------------
>                 Key: HAMA-244
>                 URL: https://issues.apache.org/jira/browse/HAMA-244
>             Project: Hama
>          Issue Type: Improvement
>          Components: bsp
>    Affects Versions: 0.2.0
>            Reporter: Edward J. Yoon
>            Assignee: Edward J. Yoon
>             Fix For: 0.2.0
>         Attachments: HAMA-244_v01.patch, HAMA-244_v02.patch
> Perhaps, every BSP program will be consists of three steps such as,  initialization,
 SPMD code implementation, and finalization from developer angle.
> However, currently there is no interface layer so users have to do all the works w/o
any guide.
> Would be nice if it allow to use a more simplified interface.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message