hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-735) Tighten the graph API
Date Fri, 22 Feb 2013 03:08:12 GMT

    [ https://issues.apache.org/jira/browse/HAMA-735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13583856#comment-13583856
] 

Hudson commented on HAMA-735:
-----------------------------

Integrated in Hama-Nightly #836 (See [https://builds.apache.org/job/Hama-Nightly/836/])
    [HAMA-735]: Tighten the graph API (Revision 1448523)

     Result = SUCCESS
tjungblut : 
Files : 
* /hama/trunk/CHANGES.txt
* /hama/trunk/core/src/main/java/org/apache/hama/HamaConfiguration.java
* /hama/trunk/core/src/main/java/org/apache/hama/HamaVersionAnnotation.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/BSP.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/BSPInterface.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/BSPJob.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/BSPJobClient.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/BSPJobID.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/BSPMaster.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/BSPPeerImpl.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/BSPTask.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/CombineFileInputFormat.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/CombineFileSplit.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/Counters.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/Directive.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/FileInputFormat.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/FileOutputFormat.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/GroomServer.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/GroomServerAction.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/GroomServerStatus.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/JobInProgress.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/JobInProgressListener.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/PartitioningRunner.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/QueueManager.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/RecoverTaskAction.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/SimpleTaskScheduler.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/TaskCompletionEvent.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/TaskInProgress.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/TaskLog.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/TaskRunner.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/TextArrayWritable.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/UpdatePeerAction.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/ft/AsyncRcvdMsgCheckpointImpl.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/ft/BSPFaultTolerantService.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/compress/BSPCompressedBundle.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/compress/BSPMessageCompressor.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/io/BufferedReadStatus.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/io/ByteBufferInputStream.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/io/ByteBufferOutputStream.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/io/CombineSpilledDataProcessor.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/io/DirectByteBufferOutputStream.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/io/DualChannelByteBufferStream.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/io/DuplexByteArrayChannel.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/io/PreFetchCache.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/io/ReadIndexStatus.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/io/SpilledByteBuffer.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/io/SpilledDataReadStatus.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/io/SpillingDataOutputBuffer.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/io/SyncFlushByteBufferOutputStream.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/io/SyncReadByteBufferInputStream.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/io/WriteSpilledDataProcessor.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/DiskQueue.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/MemoryQueue.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/MessageQueue.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/MessageTransferQueue.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/queue/SynchronizedQueue.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/sync/BSPMasterSyncClient.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/sync/BSPPeerSyncClient.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/sync/MasterSyncClient.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/sync/PeerSyncClient.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/sync/SyncClient.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/sync/SyncEvent.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/sync/SyncEventListener.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/sync/SyncException.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/sync/SyncServerRunner.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/sync/SyncServiceFactory.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/sync/ZKSyncClient.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/sync/ZKSyncEventFactory.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/sync/ZKSyncEventListener.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/sync/ZooKeeperSyncClientImpl.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/sync/ZooKeeperSyncServerImpl.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/taskallocation/BestEffortDataLocalTaskAllocator.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/taskallocation/RawSplitResource.java
* /hama/trunk/core/src/main/java/org/apache/hama/http/HttpServer.java
* /hama/trunk/core/src/main/java/org/apache/hama/ipc/BSPPeerProtocol.java
* /hama/trunk/core/src/main/java/org/apache/hama/ipc/GroomProtocol.java
* /hama/trunk/core/src/main/java/org/apache/hama/ipc/MasterProtocol.java
* /hama/trunk/core/src/main/java/org/apache/hama/monitor/Configurator.java
* /hama/trunk/core/src/main/java/org/apache/hama/monitor/MetricsRecord.java
* /hama/trunk/core/src/main/java/org/apache/hama/monitor/MetricsTag.java
* /hama/trunk/core/src/main/java/org/apache/hama/monitor/Monitor.java
* /hama/trunk/core/src/main/java/org/apache/hama/monitor/MonitorListener.java
* /hama/trunk/core/src/main/java/org/apache/hama/monitor/ZKCollector.java
* /hama/trunk/core/src/main/java/org/apache/hama/monitor/fd/NodeEventListener.java
* /hama/trunk/core/src/main/java/org/apache/hama/monitor/fd/NodeStatus.java
* /hama/trunk/core/src/main/java/org/apache/hama/monitor/fd/Sensor.java
* /hama/trunk/core/src/main/java/org/apache/hama/monitor/fd/Supervisor.java
* /hama/trunk/core/src/main/java/org/apache/hama/monitor/fd/UDPSensor.java
* /hama/trunk/core/src/main/java/org/apache/hama/pipes/BinaryProtocol.java
* /hama/trunk/core/src/main/java/org/apache/hama/pipes/Submitter.java
* /hama/trunk/core/src/main/java/org/apache/hama/util/BSPNetUtils.java
* /hama/trunk/core/src/main/java/org/apache/hama/util/BSPServletUtil.java
* /hama/trunk/core/src/main/java/org/apache/hama/util/Bytes.java
* /hama/trunk/core/src/main/java/org/apache/hama/util/ClusterUtil.java
* /hama/trunk/core/src/main/java/org/apache/hama/util/LRUCache.java
* /hama/trunk/core/src/main/java/org/apache/hama/util/RandomVariable.java
* /hama/trunk/core/src/main/java/org/apache/hama/util/ReflectionUtils.java
* /hama/trunk/core/src/main/java/org/apache/hama/util/RunJar.java
* /hama/trunk/core/src/main/java/org/apache/hama/util/StringArrayWritable.java
* /hama/trunk/core/src/main/java/org/apache/hama/util/VersionInfo.java
* /hama/trunk/core/src/main/java/org/apache/hama/zookeeper/ZKServerTool.java
* /hama/trunk/core/src/test/java/org/apache/hama/HamaCluster.java
* /hama/trunk/core/src/test/java/org/apache/hama/HamaClusterTestCase.java
* /hama/trunk/core/src/test/java/org/apache/hama/HamaTestCase.java
* /hama/trunk/core/src/test/java/org/apache/hama/MiniBSPCluster.java
* /hama/trunk/core/src/test/java/org/apache/hama/MiniZooKeeperCluster.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/TestBSPMasterGroomServer.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/TestClusterStatus.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/TestFileInputFormat.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/TestLocalRunner.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/TestPartitioning.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/TestZooKeeper.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/message/TestSpillingQueue.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/message/compress/TestBSPMessageCompressor.java
* /hama/trunk/core/src/test/java/org/apache/hama/examples/ClassSerializePrinting.java
* /hama/trunk/core/src/test/java/org/apache/hama/ipc/TestIPC.java
* /hama/trunk/core/src/test/java/org/apache/hama/ipc/TestRPC.java
* /hama/trunk/core/src/test/java/org/apache/hama/monitor/TestConfigurator.java
* /hama/trunk/core/src/test/java/org/apache/hama/monitor/fd/TestFD.java
* /hama/trunk/core/src/test/java/org/apache/hama/util/TestBytes.java
* /hama/trunk/core/src/test/java/org/apache/hama/util/TestRandomVariable.java
* /hama/trunk/core/src/test/java/org/apache/hama/zookeeper/TestZKTools.java
* /hama/trunk/examples/src/main/java/org/apache/hama/examples/BipartiteMatching.java
* /hama/trunk/examples/src/main/java/org/apache/hama/examples/ExampleDriver.java
* /hama/trunk/examples/src/main/java/org/apache/hama/examples/GradientDescentExample.java
* /hama/trunk/examples/src/main/java/org/apache/hama/examples/InlinkCount.java
* /hama/trunk/examples/src/main/java/org/apache/hama/examples/Kmeans.java
* /hama/trunk/examples/src/main/java/org/apache/hama/examples/MindistSearch.java
* /hama/trunk/examples/src/main/java/org/apache/hama/examples/PageRank.java
* /hama/trunk/examples/src/main/java/org/apache/hama/examples/SSSP.java
* /hama/trunk/examples/src/main/java/org/apache/hama/examples/SpMV.java
* /hama/trunk/examples/src/main/java/org/apache/hama/examples/util/DenseVectorWritable.java
* /hama/trunk/examples/src/main/java/org/apache/hama/examples/util/Generator.java
* /hama/trunk/examples/src/main/java/org/apache/hama/examples/util/SparseVectorWritable.java
* /hama/trunk/examples/src/main/java/org/apache/hama/examples/util/SymmetricMatrixGen.java
* /hama/trunk/examples/src/test/java/org/apache/hama/examples/CombineExampleTest.java
* /hama/trunk/examples/src/test/java/org/apache/hama/examples/LinearRegressionTest.java
* /hama/trunk/examples/src/test/java/org/apache/hama/examples/LogisticRegressionTest.java
* /hama/trunk/examples/src/test/java/org/apache/hama/examples/MindistSearchTest.java
* /hama/trunk/examples/src/test/java/org/apache/hama/examples/PageRankTest.java
* /hama/trunk/examples/src/test/java/org/apache/hama/examples/PiEstimatorTest.java
* /hama/trunk/examples/src/test/java/org/apache/hama/examples/RandBenchTest.java
* /hama/trunk/examples/src/test/java/org/apache/hama/examples/SSSPTest.java
* /hama/trunk/examples/src/test/java/org/apache/hama/examples/SymmetricMatrixGenTest.java
* /hama/trunk/graph/src/main/java/org/apache/hama/graph/AbstractAggregator.java
* /hama/trunk/graph/src/main/java/org/apache/hama/graph/AggregationRunner.java
* /hama/trunk/graph/src/main/java/org/apache/hama/graph/Edge.java
* /hama/trunk/graph/src/main/java/org/apache/hama/graph/GraphJob.java
* /hama/trunk/graph/src/main/java/org/apache/hama/graph/GraphJobMessage.java
* /hama/trunk/graph/src/main/java/org/apache/hama/graph/GraphJobRunner.java
* /hama/trunk/graph/src/main/java/org/apache/hama/graph/Vertex.java
* /hama/trunk/graph/src/main/java/org/apache/hama/graph/VertexInputReader.java
* /hama/trunk/graph/src/main/java/org/apache/hama/graph/VertexInterface.java
* /hama/trunk/graph/src/main/java/org/apache/hama/graph/VerticesInfo.java
* /hama/trunk/graph/src/test/java/org/apache/hama/graph/TestSubmitGraphJob.java
* /hama/trunk/graph/src/test/java/org/apache/hama/graph/example/PageRank.java

                
> Tighten the graph API 
> ----------------------
>
>                 Key: HAMA-735
>                 URL: https://issues.apache.org/jira/browse/HAMA-735
>             Project: Hama
>          Issue Type: Improvement
>          Components: graph
>    Affects Versions: 0.6.0
>            Reporter: Thomas Jungblut
>            Assignee: Thomas Jungblut
>             Fix For: 0.6.1, 0.7.0
>
>         Attachments: HAMA-735_1.patch, HAMA-735_2.patch
>
>
> Tighten the API by the following improvements:
> - replace the need to provide a new object of vertex parts
> - readState/writeState shouldn't be forced to override (clutters code with empty methods)
> - add preconditions for not supplied readers 
> - generalize the usage of vertex part classes and unify their usage
> - replace unuseful testcases / test methods
> - simplify graph logic by removing repair functionalities
> - formatting + organize of imports
> - add WritableComparable<?> to the vertex ID for efficient merging of vertices
and joining of them with messages

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message