giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yi Lu <luyi0...@gmail.com>
Subject Re: Aggregate sent message message bytes increase with the number of workers
Date Thu, 12 Jun 2014 02:42:45 GMT
could you please share your job log or Giraph code?

Best Regards,
-Yi


On Thu, Jun 12, 2014 at 3:24 AM, Liannet Reyes <liannetrh@gmail.com> wrote:

> Actually I am using aggregators, but I didn't know this messages were
> aggregated together with the messages generated by my algorithm.
>
>
> 2014-06-11 19:05 GMT+02:00 Yi Lu <luyi0619@gmail.com>:
>
> hi,
>>
>> The reason is you are using combiner
>>
>>
>> On Thursday, June 12, 2014, Liannet Reyes <liannetrh@gmail.com> wrote:
>>
>>> Hi all,
>>>
>>> I've noticed that the aggregated message bytes counter increases with
>>> the number of workers, even when the total amount of messages sent remains
>>> the same!
>>>
>>> For instance while using only 1 worker the messages bytes is 1000, no
>>> matter how many times I run the program this number remains the same, but
>>> using 2 workers this number slightly increase (1060), and the same thing by
>>> adding more workers.
>>>
>>> Could someone explain me how is this possible? It is likely to happen
>>> because of checksums or another mechanism to handle communication but I
>>> would really like to know the right reason.
>>>
>>>  Regards,
>>>
>>> Liannet
>>>
>>
>>
>> --
>> Best Regards,
>> -Yi
>>
>>
>

Mime
View raw message