giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eli Reisman (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-397) We should have copies of aggregators per thread to avoid synchronizing on aggregate()
Date Tue, 06 Nov 2012 19:04:13 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13491714#comment-13491714
] 

Eli Reisman commented on GIRAPH-397:
------------------------------------

No problem! I like what you guys have been doing, and I think the speed
increases are great.

I am a bit worried about the changes making the low-memory per-worker,
scale-out model less effective, but in the end my goal there is to make the
use cases I was being pestered about work for anyone who might be curious
to adopt Giraph into their Hadoop solution set. If this stuff is helping
the FB case, lets get FB up on the "Powered By" page ASAP, this will also
help with wider adoption! Then we can worry about making it work for
different kinds of clusters/resource pools. Wide adoption for Giraph is my
motivating goal.

Great work, everyone. Can't wait to jump back in with some code!



                
> We should have copies of aggregators per thread to avoid synchronizing on aggregate()
> -------------------------------------------------------------------------------------
>
>                 Key: GIRAPH-397
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-397
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Maja Kabiljo
>            Assignee: Maja Kabiljo
>            Priority: Minor
>         Attachments: GIRAPH-397.patch, GIRAPH-397.patch
>
>
> Fixing one of TODOs from GIRAPH-273. Adding copies of aggregators for each thread allows
us not to have to synchronize on each aggregate call. Aggregated values from each thread can
be aggregated together after computation is finished.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message