incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Thomas Jungblut <thomas.jungb...@googlemail.com>
Subject Re: PageRank hang
Date Tue, 21 Jun 2011 12:38:15 GMT
Oh crap :D
Thanks Edward, I wasn't aware of this "trick".

Thank you very much!



2011/6/21 Edward J. Yoon <edwardyoon@apache.org>

> Hi,
>
> I talked w/ thomas about HAMA-395 on twitter,
>
> Thomas Jungblut:
> @eddieyoon the main problem is that I can't figure it out why. The BSP
> method finishes and written out the complete results. But no cleanup
> 13 minutes ago in reply to eddieyoon from web
>
> And, I'm reply to hama-dev@ so that we can share about this.
>
> As mentioned
> http://incubator.apache.org/hama/docs/r0.2.0/ApacheHama-0.2_UserGuide.pdf,
> The BSP job will be finished only when all the processes have no more
> local and outgoing queue entries and all processes are done, or killed
> by the user.
>
> Hence, you have to clear all queues manually after escape from main while
> loop.
>
> +    // Clears all queues entries.
> +    peer.clear();
> +    // finally save the chunk of pageranks
> +    PageRankBase.savePageRankMap(peer, conf, lastTentativePagerank);
> +    LOG.info("Finished with iteration " + iteration + "!");
>
> HAMA-395-v9.patch fixes that problem, and works well on my test cluster. :)
>
> --
> Best Regards, Edward J. Yoon
> @eddieyoon
>



-- 
Thomas Jungblut
Berlin

mobile: 0170-3081070

business: thomas.jungblut@testberichte.de
private: thomas.jungblut@gmail.com

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message