giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eli Reisman (JIRA)" <j...@apache.org>
Subject [jira] [Created] (GIRAPH-314) Implement better message grouping to improve performance in SimpleTriangleClosingVertex
Date Thu, 23 Aug 2012 20:55:41 GMT
Eli Reisman created GIRAPH-314:
----------------------------------

             Summary: Implement better message grouping to improve performance in SimpleTriangleClosingVertex
                 Key: GIRAPH-314
                 URL: https://issues.apache.org/jira/browse/GIRAPH-314
             Project: Giraph
          Issue Type: Improvement
          Components: examples
    Affects Versions: 0.2.0
            Reporter: Eli Reisman
            Assignee: Eli Reisman
            Priority: Trivial
             Fix For: 0.2.0


After running SimpleTriangleClosingVertex at scale I'm thinking the sendMessageToAllEdges()
is pretty in the code, but its not a good idea in practice since each vertex V sends degree(V)^2
messages right in the first superset in this algorithm. Could do something with a combiner
etc. but just grouping messages by hand at the application level by using IntArrayListWritable
again does the trick fine.

Probably should have just done it this way before, but sendMessageToAllEdges() looked so nice.
Sigh. Changed unit tests to reflect this new approach, passes mvn verify and cluster, etc.


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message