giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eli Reisman" <initialcont...@gmail.com>
Subject Review Request: Refactor GraphMapper
Date Wed, 09 Jan 2013 05:43:49 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/8898/
-----------------------------------------------------------

Review request for giraph.


Description
-------

Longer description available at the JIRA site. Short version: cleans up and refactors GraphMapper.
Begins a multistage process of setting up the underlying cluster framework (MRv1, MRv2 + YARN,
pure YARN, other cluster management platform...) to be decoupled from Giraph's BSP business
logic. After this patch, the main connection to Hadoop left in the processing code is the
Mapper#Context, and the various references it publishes into Giraph from Hadoop. Later JIRAs
will include more interfaces and a cleaner decoupling. Again, see the JIRA for more details.
Thanks!


Diffs
-----

  giraph-core/src/main/java/org/apache/giraph/bsp/BspService.java 5c44030 
  giraph-core/src/main/java/org/apache/giraph/bsp/CentralizedServiceWorker.java 56a8288 
  giraph-core/src/main/java/org/apache/giraph/conf/GiraphConfiguration.java df7b80e 
  giraph-core/src/main/java/org/apache/giraph/graph/ComputeCallable.java 3292517 
  giraph-core/src/main/java/org/apache/giraph/graph/GraphFunctions.java PRE-CREATION 
  giraph-core/src/main/java/org/apache/giraph/graph/GraphMapper.java dd4dee4 
  giraph-core/src/main/java/org/apache/giraph/graph/GraphState.java ee9e6a8 
  giraph-core/src/main/java/org/apache/giraph/graph/GraphTaskManager.java PRE-CREATION 
  giraph-core/src/main/java/org/apache/giraph/graph/MapFunctions.java f5909d3 
  giraph-core/src/main/java/org/apache/giraph/master/BspServiceMaster.java 4483385 
  giraph-core/src/main/java/org/apache/giraph/master/MasterCompute.java cdb9e85 
  giraph-core/src/main/java/org/apache/giraph/metrics/AggregatedMetrics.java 6052fd8 
  giraph-core/src/main/java/org/apache/giraph/metrics/WorkerSuperstepMetrics.java 8fec14d

  giraph-core/src/main/java/org/apache/giraph/vertex/Vertex.java d1fbe14 
  giraph-core/src/main/java/org/apache/giraph/worker/BspServiceWorker.java f33fe58 
  giraph-core/src/main/java/org/apache/giraph/worker/InputSplitsCallable.java ec4780e 
  giraph-core/src/main/java/org/apache/giraph/zk/ZooKeeperManagerFactory.java PRE-CREATION


Diff: https://reviews.apache.org/r/8898/diff/


Testing
-------


Thanks,

Eli Reisman


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message