hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Filipe David Manana <fdman...@apache.org>
Subject Re: [jira] Commented: (HAMA-282) Add superstep counter
Date Fri, 20 Aug 2010 11:52:06 GMT
On Fri, Aug 20, 2010 at 8:04 AM, Edward J. Yoon <edwardyoon@apache.org>wrote:

> Dear fdmanana, Thanks for your interest.
>

You're welcome.
It's been a while now that I got interested in Hama. However I haven't yet
looked carefully to its code.


>
> > Is this a good feature to start with?
>
> Yes, I think so. BTW, you need to wait few days for this. The reason
> is that the number of supersteps should be counted by the master
> server but I'm heavily touching code of master/slave server for
> HAMA-276 now. Moreover, there is a lot of hard coded path and TODO
> things.
>
> However, It is OK to contribute only part of superstep counting.
> Please see the part of BSPPeer.enterbarrier() method and heartbeat
> messages between the master/slave servers.
> ----
>
> And, let me explain more detail about the current status of HAMA TRUNK ....
>
> When user submits a BSP job, the mechanism is almost same with the M/R
> framework. The basic flow is as below:
>
> 1) User submits a BSP job to Hama BSP cluster.
> 2) Then, the BSPMaster will manage jobs that user have submitted to
> the BSP cluster.
>  2-1) Adding job to the scheduler.
>  2-2) Assign Task to slaves.
> 3) the GroomServer (slave) copies job/jar file to local and launches
> tasks on its host.
>
> And, Hadoop RPC will be used for the BSP send, get and sync
> communication among BSPPeer.
>
> Now the no. 3) is not implemented yet.
>

Thanks for explanation :)
I'm finishing reading the BSP paper from Leslie.
I'll then jump into the code.

cheers


>
> Thanks.
>
> On Thu, Aug 19, 2010 at 8:38 PM, Filipe Manana (JIRA) <jira@apache.org>
> wrote:
> >
> >    [
> https://issues.apache.org/jira/browse/HAMA-282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12900255#action_12900255]
> >
> > Filipe Manana commented on HAMA-282:
> > ------------------------------------
> >
> > Hello,
> >
> > I would like to start contributing to Hama.
> > Is this a good feature to start with?
> >
> > cheers
> >
> >> Add superstep counter
> >> ---------------------
> >>
> >>                 Key: HAMA-282
> >>                 URL: https://issues.apache.org/jira/browse/HAMA-282
> >>             Project: Hama
> >>          Issue Type: Sub-task
> >>            Reporter: Edward J. Yoon
> >>
> >
> >
> > --
> > This message is automatically generated by JIRA.
> > -
> > You can reply to this email to add a comment to the issue online.
> >
> >
>
>
>
> --
> Best Regards, Edward J. Yoon
> edwardyoon@apache.org
> http://blog.udanax.org
>



-- 
Filipe David Manana,
fdmanana@gmail.com, fdmanana@apache.org

"Reasonable men adapt themselves to the world.
 Unreasonable men adapt the world to themselves.
 That's why all progress depends on unreasonable men."

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message