hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-903) Refactor Queue interface and implementations
Date Fri, 13 Feb 2015 00:24:12 GMT

    [ https://issues.apache.org/jira/browse/HAMA-903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319306#comment-14319306
] 

Hudson commented on HAMA-903:
-----------------------------

FAILURE: Integrated in Hama-Nightly-for-Hadoop-2.x #517 (See [https://builds.apache.org/job/Hama-Nightly-for-Hadoop-2.x/517/])
HAMA-903: Refactor Queue interface and implementations (edwardyoon: rev 1659134)
* /hama/trunk/core/src/main/java/org/apache/hama/Constants.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/BSPMessageBundle.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/BSPPeerImpl.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/LocalBSPRunner.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/AbstractMessageManager.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/AbstractOutgoingMessageManager.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/BSPMessageInterface.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/ByteArrayMessageQueue.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/DefaultMessageQueue.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/DiskQueue.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/MemoryQueue.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/MessageQueue.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/SingleLockQueue.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/SortedMemoryQueue.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/SpillingQueue.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/SynchronizedQueue.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/TestBSPMasterGroomServer.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/TestPartitioning.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/TestPersistQueue.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/message/TestDiskQueue.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/message/TestHamaAsyncMessageManager.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/message/TestHamaMessageManager.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/message/TestSpillingQueue.java
* /hama/trunk/core/src/test/java/org/apache/hama/pipes/TestPipes.java
* /hama/trunk/graph/src/main/java/org/apache/hama/graph/IncomingVertexMessageManager.java


> Refactor Queue interface and implementations
> --------------------------------------------
>
>                 Key: HAMA-903
>                 URL: https://issues.apache.org/jira/browse/HAMA-903
>             Project: Hama
>          Issue Type: Improvement
>          Components: bsp core
>    Affects Versions: 0.6.4
>            Reporter: Edward J. Yoon
>            Assignee: Edward J. Yoon
>             Fix For: 0.7.0
>
>         Attachments: HAMA-903_v01.patch, HAMA-903_v02.patch
>
>
> Instead of unbundling (and deserializing, decompressing) bundles into memory, disk, or
spilling queue, we should use bundles in efficient and asynchronous way. My idea is using
of bundle's iterator directly. 
> This will reduce the memory space and improve the performance.
> P.S., For the sorted queue, I'll create sub-ticket.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message