hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon" <edwardy...@apache.org>
Subject Re: [CANCELED][VOTE] Hama 0.6 (RC5)
Date Wed, 21 Nov 2012 02:09:56 GMT
>> (currentTime - tip.lastPingedTimestamp) > monitorPeriod)

And, above condition is so sensitive.

http://svn.apache.org/repos/asf/hama/trunk/core/src/main/java/org/apache/hama/bsp/GroomServer.java

On Wed, Nov 21, 2012 at 9:54 AM, Edward J. Yoon <edwardyoon@apache.org> wrote:
> Solved by set HAMA_HEAPSIZE to 4 GB.
>
> On Tue, Nov 20, 2012 at 8:37 PM, Edward J. Yoon <edwardyoon@apache.org> wrote:
>> Default of hdfs block size is 64 MB but these days many people usually
>> use 128 MB or 256 MB. If we can reduce memory use, we must do.
>>
>> On Tue, Nov 20, 2012 at 4:25 PM, Thomas Jungblut
>> <thomas.jungblut@gmail.com> wrote:
>>> Try 32m blocks  ;-)
>>> We have to recheck if the pre job partitioner works, I missed checking it.
>>> Am 20.11.2012 08:18 schrieb "Edward" <edward@udanax.org>:
>>>
>>>> Okay. It looks like a memory issue. I'll check tomorrow.
>>>>
>>>> Sent from my iPhone
>>>>
>>>> On Nov 20, 2012, at 3:55 PM, Thomas Jungblut <thomas.jungblut@gmail.com>
>>>> wrote:
>>>>
>>>> > Like in mr you should steer this number by the block size. You can't
>>>> > determine the splits correctly without iterating them.
>>>> > Am 20.11.2012 07:42 schrieb "Thomas Jungblut" <thomas.jungblut@gmail.com
>>>> >:
>>>> >
>>>> >> The splits are never deterministic when we are not splitting across
>>>> block
>>>> >> boundaries.
>>>> >> Am 20.11.2012 07:39 schrieb "Edward J. Yoon" <edwardyoon@apache.org>:
>>>> >>
>>>> >>> changed to use just block nums?
>>>> >>>
>>>> >>> Sadly graph examples on 1 ~ 2 GB random graph are not works
well. My
>>>> >>> settings are:
>>>> >>>
>>>> >>> HDFS block size: 256 mb
>>>> >>> bsp.tasks.maximum: 3
>>>> >>> bsp.child.java.opts: -Xmx15524m
>>>> >>>
>>>> >>> On Tue, Nov 20, 2012 at 2:56 AM, Tommaso Teofili
>>>> >>> <tommaso.teofili@gmail.com> wrote:
>>>> >>>> great job, thanks!
>>>> >>>> Tommaso
>>>> >>>>
>>>> >>>>
>>>> >>>> 2012/11/19 Thomas Jungblut <thomas.jungblut@gmail.com>
>>>> >>>>
>>>> >>>>> done
>>>> >>>>> https://issues.apache.org/jira/browse/HAMA-678
>>>> >>>>>
>>>> >>>>>
>>>> >>>>> 2012/11/18 Edward J. Yoon <edwardyoon@apache.org>
>>>> >>>>>
>>>> >>>>>> We have to fix fileinput splitter.
>>>> >>>>>>
>>>> >>>>>> On Thu, Nov 15, 2012 at 4:46 PM, Thomas Jungblut
>>>> >>>>>> <thomas.jungblut@gmail.com> wrote:
>>>> >>>>>>> +1.
>>>> >>>>>>>
>>>> >>>>>>> 2012/11/15 Tommaso Teofili <tommaso.teofili@gmail.com>
>>>> >>>>>>>
>>>> >>>>>>>> +1
>>>> >>>>>>>>
>>>> >>>>>>>> Tommaso
>>>> >>>>>>>>
>>>> >>>>>>>>
>>>> >>>>>>>> 2012/11/15 Edward J. Yoon <edwardyoon@apache.org>
>>>> >>>>>>>>
>>>> >>>>>>>>> Hi all,
>>>> >>>>>>>>>
>>>> >>>>>>>>> Here's new RC for Hama 0.6.
>>>> >>>>>>>>>
>>>> >>>>>>>>> Artifacts:
>>>> >>>>>>>>> http://people.apache.org/~edwardyoon/dist/0.6-RC5/
>>>> >>>>>>>>>
>>>> >>>>>>>>> SVN Tag:
>>>> >>>>>>>>> http://svn.apache.org/repos/asf/hama/tags/0.6-RC5/
>>>> >>>>>>>>>
>>>> >>>>>>>>> Please vote for this release.
>>>> >>>>>>>>>
>>>> >>>>>>>>> I'm +1.
>>>> >>>>>>>>>
>>>> >>>>>>>>> --
>>>> >>>>>>>>> Best Regards, Edward J. Yoon
>>>> >>>>>>>>> @eddieyoon
>>>> >>>>>>
>>>> >>>>>>
>>>> >>>>>>
>>>> >>>>>> --
>>>> >>>>>> Best Regards, Edward J. Yoon
>>>> >>>>>> @eddieyoon
>>>> >>>
>>>> >>>
>>>> >>>
>>>> >>> --
>>>> >>> Best Regards, Edward J. Yoon
>>>> >>> @eddieyoon
>>>> >>
>>>>
>>
>>
>>
>> --
>> Best Regards, Edward J. Yoon
>> @eddieyoon
>
>
>
> --
> Best Regards, Edward J. Yoon
> @eddieyoon



-- 
Best Regards, Edward J. Yoon
@eddieyoon

Mime
View raw message