giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alessandro Presta" <alessan...@fb.com>
Subject Review Request: Allow creation of graph by adding edges that span multiple workers
Date Tue, 30 Oct 2012 23:44:46 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/7784/
-----------------------------------------------------------

Review request for giraph.


Description
-------

See https://issues.apache.org/jira/browse/GIRAPH-155


This addresses bug GIRAPH-155.
    https://issues.apache.org/jira/browse/GIRAPH-155


Diffs
-----

  /trunk/giraph/src/main/java/org/apache/giraph/GiraphConfiguration.java 1403451 
  /trunk/giraph/src/main/java/org/apache/giraph/ImmutableClassesGiraphConfiguration.java 1403451

  /trunk/giraph/src/main/java/org/apache/giraph/bsp/CentralizedServiceMaster.java 1403451

  /trunk/giraph/src/main/java/org/apache/giraph/comm/WorkerServer.java 1403451 
  /trunk/giraph/src/main/java/org/apache/giraph/comm/netty/NettyWorkerClientRequestProcessor.java
1403451 
  /trunk/giraph/src/main/java/org/apache/giraph/comm/netty/NettyWorkerServer.java 1403451

  /trunk/giraph/src/main/java/org/apache/giraph/comm/requests/SendPartitionMutationsRequest.java
1403451 
  /trunk/giraph/src/main/java/org/apache/giraph/graph/BasicVertexValueReader.java PRE-CREATION

  /trunk/giraph/src/main/java/org/apache/giraph/graph/BspService.java 1403451 
  /trunk/giraph/src/main/java/org/apache/giraph/graph/BspServiceMaster.java 1403451 
  /trunk/giraph/src/main/java/org/apache/giraph/graph/BspServiceWorker.java 1403451 
  /trunk/giraph/src/main/java/org/apache/giraph/graph/BspUtils.java 1403451 
  /trunk/giraph/src/main/java/org/apache/giraph/graph/EdgeInputFormat.java PRE-CREATION 
  /trunk/giraph/src/main/java/org/apache/giraph/graph/EdgeInputSplitsCallable.java PRE-CREATION

  /trunk/giraph/src/main/java/org/apache/giraph/graph/EdgeReader.java PRE-CREATION 
  /trunk/giraph/src/main/java/org/apache/giraph/graph/EdgeWithSource.java PRE-CREATION 
  /trunk/giraph/src/main/java/org/apache/giraph/graph/GiraphJob.java 1403451 
  /trunk/giraph/src/main/java/org/apache/giraph/graph/GraphMapper.java 1403451 
  /trunk/giraph/src/main/java/org/apache/giraph/graph/InputSplitsCallable.java 1403451 
  /trunk/giraph/src/main/java/org/apache/giraph/graph/MasterThread.java 1403451 
  /trunk/giraph/src/main/java/org/apache/giraph/graph/VertexInputSplitsCallable.java PRE-CREATION

  /trunk/giraph/src/main/java/org/apache/giraph/graph/VertexReader.java 1403451 
  /trunk/giraph/src/main/java/org/apache/giraph/graph/VertexResolver.java 1403451 
  /trunk/giraph/src/main/java/org/apache/giraph/graph/VertexValueInputFormat.java PRE-CREATION

  /trunk/giraph/src/main/java/org/apache/giraph/graph/VertexValueReader.java PRE-CREATION

  /trunk/giraph/src/main/java/org/apache/giraph/io/GiraphFileInputFormat.java PRE-CREATION

  /trunk/giraph/src/main/java/org/apache/giraph/io/GiraphTextInputFormat.java PRE-CREATION

  /trunk/giraph/src/main/java/org/apache/giraph/io/IntIntTextVertexValueInputFormat.java PRE-CREATION

  /trunk/giraph/src/main/java/org/apache/giraph/io/IntNullTextEdgeInputFormat.java PRE-CREATION

  /trunk/giraph/src/main/java/org/apache/giraph/io/TextEdgeInputFormat.java PRE-CREATION 
  /trunk/giraph/src/main/java/org/apache/giraph/io/TextVertexInputFormat.java 1403451 
  /trunk/giraph/src/main/java/org/apache/giraph/io/TextVertexValueInputFormat.java PRE-CREATION

  /trunk/giraph/src/main/java/org/apache/giraph/utils/FileUtils.java 1403451 
  /trunk/giraph/src/main/java/org/apache/giraph/utils/InternalVertexRunner.java 1403451 
  /trunk/giraph/src/test/java/org/apache/giraph/BspCase.java 1403451 
  /trunk/giraph/src/test/java/org/apache/giraph/TestEdgeInput.java PRE-CREATION 
  /trunk/giraph/src/test/java/org/apache/giraph/TestJsonBase64Format.java 1403451 

Diff: https://reviews.apache.org/r/7784/diff/


Testing
-------

1) mvn verify
2) pseudo-distributed tests
3) PageRank on cluster with real text input (will post perf results on the issue)


Thanks,

Alessandro Presta


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message