hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-900) Rotation task scheduler
Date Wed, 13 Jan 2016 22:26:40 GMT

    [ https://issues.apache.org/jira/browse/HAMA-900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097144#comment-15097144
] 

Edward J. Yoon commented on HAMA-900:
-------------------------------------

Thanks for reminding me.

In the JobInProgress.java, you can see the two obtainNewTask() methods: obtainNewTask(Map<String,
GroomServerStatus> groomStatuses) and obtainNewTask(TaskInProgress task, Map<String,
GroomServerStatus> groomStatuses, BSPResource[] resources).

The latter API uses a taskAllocationStrategy. As far as I know, it originally created for
task recovery and re-allocation. The default scheduler SimpleTaskWorkerManager.java still
use former API like below. So, this issue is still TODO thing.

{code}
      while ((t = jip.obtainNewTask(this.groomStatuses)) != null) {
        taskSet.add(t);
        // Scheduled all tasks
        if (++cnt == this.jip.tasks.length) {
          break;
        }
      }

      ..
      // assembly into actions
      for (Task task : taskSet) {
        GroomServerStatus groomStatus = jip.getGroomStatusForTask(task);
{code}

> Rotation task scheduler
> -----------------------
>
>                 Key: HAMA-900
>                 URL: https://issues.apache.org/jira/browse/HAMA-900
>             Project: Hama
>          Issue Type: New Feature
>          Components: bsp core
>            Reporter: Edward J. Yoon
>
> To spread tasks widely, I need a FIFO job scheduler that assign tasks one at a time in
rotation of groom servers (a method of dealing cards).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message