hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod Kumar Vavilapalli (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-2766) [HOD] No way to set HADOOP_OPTS environment variable to the Hadoop daemons through HOD
Date Fri, 01 Feb 2008 12:31:11 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Vinod Kumar Vavilapalli updated HADOOP-2766:

    Attachment: hadoop-2766

Fixed this. Now users can set HADOOP_OPTS by specifying it in configuration parameters gridservice-mapred.envs
or gridservice-hdfs.envs depending on where it need to be specified. Any special characters
present have to escaped.
  e.g: ./bin/hod -c ~/hodrc.old -o "allocate ~/hod/clusterpath 4" -t ~/hadoop-0.17.0-dev.tar.gz
--gridservice-hdfs.envs="HADOOP_OPTS=-XX:+MaxFDLimit\ -XX:MaxHeapFreeRatio\=70" --gridservice-mapred.envs="HADOOP_OPTS=-XX:MaxHeapFreeRatio\=70"

Also forcing validation of both envs variables, absence of which was throwing uncaught exceptions
when invalid list of keyval pairs is specified by user.

> [HOD] No way to set HADOOP_OPTS environment variable to the Hadoop daemons through HOD
> --------------------------------------------------------------------------------------
>                 Key: HADOOP-2766
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2766
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: contrib/hod
>    Affects Versions: 0.16.0
>            Reporter: Hemanth Yamijala
>            Assignee: Vinod Kumar Vavilapalli
>            Priority: Critical
>         Attachments: hadoop-2766
> For purposes of performance tuning it should be possible to set some environment variables
that Hadoop honors before launching the Hadoop daemons. For e.g. to set the heap size of the
JVM, we should set the HADOOP_HEAPSIZE variable. These can be configured through hodrc using
the gridservice-mapred.envs environment variable. This works for everything *except* HADOOP_OPTS,
which is also useful, for e.g. to pass in Garbage collection parameters to the JVM, like -XX:+UseParallelGC.
This is because HOD tries to set HADOOP_OPTS from the gridservice-mapred.java-opts variable,
but it does not read the java-opts variable anywhere properly.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message