hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bryan Pendleton (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-36) Adding some uniformity/convenience to environment management
Date Mon, 13 Feb 2006 20:05:12 GMT
Adding some uniformity/convenience to environment management
------------------------------------------------------------

         Key: HADOOP-36
         URL: http://issues.apache.org/jira/browse/HADOOP-36
     Project: Hadoop
        Type: Improvement
  Components: conf  
    Reporter: Bryan Pendleton


Currently, "slaves" are loaded from ~/.slaves. What would be better would be to default from
something like conf/hadoop-slaves

Perhaps split slaves, having a different set for "datanodes" vs. "tasktracker" nodes. ie,
conf/hadoop-slaves-tasktracker, conf/hadoop-slaves-datanodes, or some similar split. There's
the possibility it's worth building in the assumption that tasktracker is a superset, and
thus implicitly includes datanodes, but this might be a bad assumption.

Also, make sure all scripts source something like conf/hadoop-env.sh. Thus, the user can edit
hadoop-env.sh to specify JAVA_HOME, or an alternate HADOOP_SLAVES location. It would also
be desirable to have a seed CLASSPATH here. Possibly name it HADOOP_CLASSPATH, to make it
explicit and not make hadoop scripts possibly interact with an otherwise-set system CLASSPATH
variable.

These changes would probably be useful to the nutch project, too.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira


Mime
View raw message