hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon" <edwardy...@apache.org>
Subject Re: svn commit: r1354365 - /hama/trunk/graph/src/main/java/org/apache/hama/graph/GraphJobRunner.java
Date Wed, 11 Jul 2012 02:12:44 GMT
This quick-patch was for avoiding huge memory usage (commodity PCs
cluster) but, seems I made a bug.

Since each peer loads different split data, some tasks start bsp()
earlier than others.

Will fix on HAMA-599

On Wed, Jun 27, 2012 at 5:19 PM,  <edwardyoon@apache.org> wrote:
> Author: edwardyoon
> Date: Wed Jun 27 08:19:17 2012
> New Revision: 1354365
>
> URL: http://svn.apache.org/viewvc?rev=1354365&view=rev
> Log:
> Increase sync interval
>
> Modified:
>     hama/trunk/graph/src/main/java/org/apache/hama/graph/GraphJobRunner.java
>
> Modified: hama/trunk/graph/src/main/java/org/apache/hama/graph/GraphJobRunner.java
> URL: http://svn.apache.org/viewvc/hama/trunk/graph/src/main/java/org/apache/hama/graph/GraphJobRunner.java?rev=1354365&r1=1354364&r2=1354365&view=diff
> ==============================================================================
> --- hama/trunk/graph/src/main/java/org/apache/hama/graph/GraphJobRunner.java (original)
> +++ hama/trunk/graph/src/main/java/org/apache/hama/graph/GraphJobRunner.java Wed Jun
27 08:19:17 2012
> @@ -429,7 +429,7 @@ public final class GraphJobRunner<V exte
>        vertex.runner = this;
>
>        lines++;
> -      if((lines % 50000) == 0) {
> +      if((lines % 100000) == 0) {
>          peer.sync();
>          GraphJobMessage msg = null;
>          while ((msg = peer.getCurrentMessage()) != null) {
>
>



-- 
Best Regards, Edward J. Yoon
@eddieyoon

Mime
View raw message