hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jeff Fenchel (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HAMA-726) Hama on Mesos
Date Mon, 02 Jun 2014 03:49:01 GMT

    [ https://issues.apache.org/jira/browse/HAMA-726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14015168#comment-14015168
] 

Jeff Fenchel edited comment on HAMA-726 at 6/2/14 3:48 AM:
-----------------------------------------------------------

Here is a patch to add in grooms managed by mesos. It has been tested on a small cluster.
It still needs updates for fault tolerance and unit tests but I will do that in another JIRA
ticket. Any feedback would be greatly appreciated! Thanks.

Also, here is the configuration to enable it if anyone wants to try it out:
        <property>
                <name>bsp.master.TaskWorkerManager.class</name>
                <value>org.apache.hama.bsp.MesosScheduler</value>
                <description> </description>
        </property>
<property>
    <name>hama.mesos.executor.uri</name>
    <value>hdfs://hdfs.name.node:port/hama.tar.gz</value>
    <description>
      Ignore this if you are not using the Mesos TaskWorkerManger. 
      This is the URI of the Hama distribution. Upload this yourself. 
    </description>
  </property>
  <property>
    <name>bsp.tasks.maximum.total</name>
    <value>10</value>
    <description>
      This is an override for the total maximum tasks that may be run.
      The default behavior is to determine a value based on the available groom
      servers. However, if using mesos, the groom servers are not yet allocated.  
      So, a value indicating the number of slots available in the cluster is needed. 
    </description>
  </property>
 <property>
    <name>hama.mesos.master</name>
    <value>local</value>
    <description>
      Ignore this if you are not using the Mesos TaskWorkerManger.
      This is the address of the Mesos master instance. If you're using
      Zookeeper for master election, use the Zookeeper address here (i.e.,
      zk://zk.apache.org:2181/hadoop/mesos).
    </description>
  </property>





was (Author: jfenc91):
Here is a patch to add in grooms managed by mesos. It has been tested on a small cluster.
It still needs updates for fault tolerance and unit tests but I will do that in another JIRA
ticket. Any feedback would be greatly appreciated! Thanks.

> Hama on Mesos
> -------------
>
>                 Key: HAMA-726
>                 URL: https://issues.apache.org/jira/browse/HAMA-726
>             Project: Hama
>          Issue Type: New Feature
>          Components: bsp core
>            Reporter: Suraj Menon
>            Assignee: Jeff Fenchel
>         Attachments: HAMA-726.patch
>
>
> Since we are going to refactor our code to work on YARN, it would be nice to keep our
abstraction levels to make it feasible to work on Mesos. 
> Documentation: http://incubator.apache.org/mesos/documentation.html
> Framework development guide:
> https://github.com/mesos/mesos/wiki/App-Framework-development-guide



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message