giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lukas Nalezenec <>
Subject Re: Graph stats in giraph.
Date Wed, 02 Apr 2014 15:45:05 GMT

If you want to reduce the number, you can replace hash partitioning with 
range partitioning. You can also add some cache to your computation and 
combine messages.


On 2.4.2014 17:36, Suijian Zhou wrote:
> Hi,
>   Does anybody know what "Aggregate sent message message bytes" means 
> in the giraph log file? I'm processing a ~500MB size of graph with 4 
> worker nodes. While I see "Aggregate sent message message 
> bytes=33120305280" in the output, would a ~500MB graph generate ~30GB 
> messages communication on 4 nodes? Thanks!
>   Best Regards,
>   Suijian

View raw message