hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arun C Murthy <ar...@yahoo-inc.com>
Subject Re: Hadoop and VMware
Date Tue, 06 May 2008 18:04:20 GMT

On May 5, 2008, at 2:03 PM, Ahmad Humayun wrote:

> Thanks Christophe :) Hadoop is running fine now :)
>
> does anyone know how to reduce this heap requirement....is such a  
> large heap
> size being imposed by Hadoop itself? Do I need to set the jvm by  
> using -Xms
> settings....anyone knows how to do that?
>

By default the hadoop daemons (JT/TT & NN/DN) use a heap-size of 1G.

You can tweak them with HADOOP_HEAPSIZE in your conf/hadoop-env.sh.

(Note: you can also set them per daemon using HADOOP_<daemon>_OPTS,  
see conf/hadoop-env.sh for details)

Arun

>
> Thanks again to everyone helping out on the mailing list ....all of  
> you are
> doing a great job :)
>
> Regards,
>
> On Tue, May 6, 2008 at 1:01 AM, Ahmad Humayun  
> <ahmad.humyn@gmail.com> wrote:
>
>> Just tried with 512 MB and 1 GB....and guess what .... it started
>> (finally!!) working at a GB.
>>
>> Is there a way to lower this requirement?.....I'll also just try  
>> to hone
>> in into the min. amount of RAM needed.
>>
>> I really can't afford using a GB of RAM for my VM....I will soon  
>> run out
>> of juice that way :(
>>
>>
>> Regards,
>>
>>
>> On Tue, May 6, 2008 at 12:49 AM, Ahmad Humayun  
>> <ahmad.humyn@gmail.com>
>> wrote:
>>
>>> Well my VM is allocated 256 MB.....I'll just increase it and  
>>> report back
>>>
>>> Plus I have just tried HelloWorld programs....and since they  
>>> hardly have
>>> any memory usage, they work.
>>>
>>>
>>> Regards,
>>>
>>>
>>> On Tue, May 6, 2008 at 12:41 AM, Christophe Taton <taton@apache.org>
>>> wrote:
>>>
>>>> Hi Ahmad,
>>>>
>>>> As the error message suggests it, your issue is likely to be  
>>>> related
>>>> to the
>>>> amount of memory available:
>>>>     Error occurred during initialization of VM
>>>>    Could not reserve enough space for object heap
>>>>
>>>> How much memory did you allocate to your VM? Can you run any other
>>>> Java
>>>> applications in your JVM?
>>>>
>>>> Christophe
>>>>
>>>> On Mon, May 5, 2008 at 9:33 PM, Ahmad Humayun  
>>>> <ahmad.humyn@gmail.com>
>>>> wrote:
>>>>
>>>>> Hi there,
>>>>>
>>>>> Has anybody tried running Hadoop on VMware (6.0). I have installed
>>>> open
>>>>> SUSE
>>>>> 10.2 as a guest OS....and I have been trying to get Hadoop  
>>>>> started,
>>>> but
>>>>> whatever I do with bin/hadoop, I keep getting this error:
>>>>> *Error occurred during initialization of VM
>>>>> Could not reserve enough space for object heap
>>>>> Could not create the Java virtual machine.*
>>>>>
>>>>> Any ideas? Is it a problem with VMware? Or maybe my java  
>>>>> environment
>>>>> setup?
>>>>> Or I'm simply doing something wrong in setting up Hadoop?
>>>>>
>>>>> Thanks again!
>>>>>
>>>>> Regards,
>>>>> --
>>>>> Ahmad Humayun
>>>>> Research Assistant
>>>>> Computer Science Dpt., LUMS
>>>>> +92 321 4457315
>>>>>
>>>>
>>>
>>>
>>>
>>> --
>>> Ahmad Humayun
>>> Research Assistant
>>> Computer Science Dpt., LUMS
>>> +92 321 4457315
>>>
>>
>>
>>
>> --
>> Ahmad Humayun
>> Research Assistant
>> Computer Science Dpt., LUMS
>> +92 321 4457315
>>
>
>
>
> -- 
> Ahmad Humayun
> Research Assistant
> Computer Science Dpt., LUMS
> +92 321 4457315


Mime
View raw message