incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-566) Add a disk-based queue
Date Sun, 20 May 2012 05:02:41 GMT

    [ https://issues.apache.org/jira/browse/HAMA-566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13279663#comment-13279663
] 

Hudson commented on HAMA-566:
-----------------------------

Integrated in Hama-Nightly #552 (See [https://builds.apache.org/job/Hama-Nightly/552/])
    [HAMA-566]: Add a disk-based queue (Revision 1340371)

     Result = ABORTED
tjungblut : 
Files : 
* /incubator/hama/trunk/CHANGES.txt
* /incubator/hama/trunk/core/src/main/java/org/apache/hama/bsp/message/AbstractMessageManager.java
* /incubator/hama/trunk/core/src/main/java/org/apache/hama/bsp/message/AvroBSPMessageBundle.java
* /incubator/hama/trunk/core/src/main/java/org/apache/hama/bsp/message/AvroMessageManagerImpl.java
* /incubator/hama/trunk/core/src/main/java/org/apache/hama/bsp/message/DiskQueue.java
* /incubator/hama/trunk/core/src/main/java/org/apache/hama/bsp/message/HadoopMessageManagerImpl.java
* /incubator/hama/trunk/core/src/main/java/org/apache/hama/bsp/message/SingleLockQueue.java
* /incubator/hama/trunk/core/src/main/java/org/apache/hama/bsp/message/SynchronizedQueue.java
* /incubator/hama/trunk/core/src/main/java/org/apache/hama/bsp/message/compress/Bzip2Compressor.java
* /incubator/hama/trunk/core/src/main/java/org/apache/hama/bsp/message/compress/SnappyCompressor.java
* /incubator/hama/trunk/core/src/test/java/org/apache/hama/MiniZooKeeperCluster.java
* /incubator/hama/trunk/core/src/test/java/org/apache/hama/bsp/TestBSPMasterGroomServer.java
* /incubator/hama/trunk/core/src/test/java/org/apache/hama/bsp/TestBSPTaskFaults.java
* /incubator/hama/trunk/core/src/test/java/org/apache/hama/bsp/TestCheckpoint.java
* /incubator/hama/trunk/core/src/test/java/org/apache/hama/bsp/TestClusterStatus.java
* /incubator/hama/trunk/core/src/test/java/org/apache/hama/bsp/TestZooKeeper.java
* /incubator/hama/trunk/core/src/test/java/org/apache/hama/bsp/message/TestAvroMessageManager.java
* /incubator/hama/trunk/core/src/test/java/org/apache/hama/bsp/message/TestHadoopMessageManager.java

                
> Add a disk-based queue
> ----------------------
>
>                 Key: HAMA-566
>                 URL: https://issues.apache.org/jira/browse/HAMA-566
>             Project: Hama
>          Issue Type: New Feature
>          Components: bsp core, messaging
>    Affects Versions: 0.5.0
>            Reporter: Thomas Jungblut
>            Assignee: Thomas Jungblut
>             Fix For: 0.5.0
>
>         Attachments: HAMA-566.patch
>
>
> After the refactoring in HAMA-521 the disk-queue is still malfunctioning. It hangs after
a superstep in the method where we switch from the local queue to the messaging queue.
> Generally it is useful to make a sequence diagram to know what happens when.
> We want to use low overhead buffered byte writing instead of sequence files and we want
to write to local disk. 
> Currently the disk queue is doing the exact opposite.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message