hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HAMA-842) Add persistent queue option to JobConf
Date Fri, 10 Jan 2014 06:22:52 GMT
Edward J. Yoon created HAMA-842:
-----------------------------------

             Summary: Add persistent queue option to JobConf
                 Key: HAMA-842
                 URL: https://issues.apache.org/jira/browse/HAMA-842
             Project: Hama
          Issue Type: New Feature
    Affects Versions: 0.6.3
            Reporter: Edward J. Yoon
            Assignee: Edward J. Yoon
             Fix For: 0.7.0


By default, incoming (local) queue will be reset in every superstep. It means that unconsumed
messages will be lost. If this is persistent queue, unconsumed messages will be persisted
in incoming queue.

{code}
  public final void clearOutgoingQueues() {
    if (localQueue != null) {
      localQueue.close();
    }
    localQueue = localQueueForNextIteration.getMessageQueue();
    localQueue.prepareRead();
    localQueueForNextIteration = getSynchronizedReceiverQueue();
    notifyInit();
  }
{code}

Simply we can add unconsumed messages to localQueueForNextIteration before switching local
queue.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message