hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-526) Multi-threaded vertex processing
Date Mon, 13 Apr 2015 08:17:13 GMT

    [ https://issues.apache.org/jira/browse/HAMA-526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14492056#comment-14492056
] 

Hudson commented on HAMA-526:
-----------------------------

FAILURE: Integrated in Hama-trunk #370 (See [https://builds.apache.org/job/Hama-trunk/370/])
HAMA-526: Multi-threaded vertex processing (edwardyoon: rev 1673127)
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/BSPPeer.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/BSPPeerImpl.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/AbstractMessageManager.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/HamaMessageManagerImpl.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/MessageManager.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/MemoryQueue.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/MessageQueue.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/SingleLockQueue.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/SortedMemoryQueue.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/TestCheckpoint.java
* /hama/trunk/examples/src/main/java/org/apache/hama/examples/MaxFlow.java
* /hama/trunk/graph/src/main/java/org/apache/hama/graph/GraphJobMessage.java
* /hama/trunk/graph/src/main/java/org/apache/hama/graph/GraphJobRunner.java
* /hama/trunk/graph/src/main/java/org/apache/hama/graph/IncomingVertexMessageManager.java
* /hama/trunk/graph/src/main/java/org/apache/hama/graph/MapVerticesInfo.java
* /hama/trunk/graph/src/main/java/org/apache/hama/graph/MessagePerVertex.java
* /hama/trunk/graph/src/main/java/org/apache/hama/graph/VerticesInfo.java


> Multi-threaded vertex processing
> --------------------------------
>
>                 Key: HAMA-526
>                 URL: https://issues.apache.org/jira/browse/HAMA-526
>             Project: Hama
>          Issue Type: Sub-task
>          Components: bsp core, graph
>            Reporter: Edward J. Yoon
>            Assignee: Edward J. Yoon
>         Attachments: patch.txt
>
>
> {code}
>   public void bsp(BSPPeer peer) throws IOException, SyncException,
>       InterruptedException {
>  
>       ...
>       while (updated && iteration < maxIteration) {
>         peer.sync();
>         ...
>         for (Map.Entry<String, LinkedList<Writable>> e : msgMap.entrySet())
{
>           if (e.getValue().size() > 0) {
>             vertices.get(e.getKey()).compute(e.getValue().iterator());
>           }
>         }
>       ...
>       }
> {code}
> Above code will run Vertex sequentially. Do you think we can run Vertex processing concurrently
using multi-threads?
> Then what's the advantages or disadvantages of using multi-threading?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message