hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robert Evans <ev...@yahoo-inc.com>
Subject Re: Hadoop JVM Size (Not MapReduce)
Date Fri, 19 Aug 2011 15:48:51 GMT
The hadoop command is just a shell script that sets up the class path before call java.  I
think if you set the ENV HADOOP_JAVA_OPTS then they will show up on the command line, but
you can look at the top of the hadoop shell script to be sure.  It has all the env vars it
supports listed there at the top.

--Bobby Evans

On 8/19/11 10:34 AM, "Adam Shook" <ashook@clearedgeit.com> wrote:

Hello all,

I have a Hadoop related application that is integrated with HDFS and is started via the command
line with "hadoop jar ..."  The amount of data used by the application changes from use case
to use case, and I have to adjust the JVM that is started using the "hadoop jar" command.
 Typically, you just set the -Xmx and -Xms variables from the "java -jar" command, but this
doesn't seem to work.

Does anyone know how I can set it?  Note that this is unrelated to the JVM size for map and
reduce tasks - there is no MapReduce involved in my application.

Thanks in advance!


PS - I imagine I can code my application to be hooked into HDFS or read from the Hadoop configuration
files by hand - but I would prefer Hadoop to do all the work for me!

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message