hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alex Newman (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-5670) Hadoop configurations should be read from a distributed system
Date Tue, 06 Apr 2010 16:31:35 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-5670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854046#action_12854046

Alex Newman commented on HADOOP-5670:

So I think their exists a couple of different conversations going on here. I suppose if all
we wish is to replace basically the -D options passed into hadoop, then I am very openminded
to a ldap based scheme as a plugin. I would be very happy if it included some scoping so that
configuration could be provided on a intra cluster, inter cluster,  host ,user or job level.
Guidelines should be provided as how not to disrupt existing ldap users. 

However their exists numerous other things which fall into the cluster configuration in which
ldap may not be the best choice. 

In regards to operations, I think deployment complexity is an argument against ldap. Even
if an organization were willing to store such configuration in their existing ldap infrastructure,
which I am skeptical of in many cases, it would require organizations not using ldap to run
additional infrastructure to solve a problem which could be solved by something already provided
by the hadoop infrastructure. I would feel as though if we saw many users deploying a isolated
ldap installation just for hadoop that we would have made people's life harder not easier.

Allen, sorry to be a pain , but could you be a bit more pedantic about what  you mean by configurations
? Do you think a hybrid system may make sense here? 

> Hadoop configurations should be read from a distributed system
> --------------------------------------------------------------
>                 Key: HADOOP-5670
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5670
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: conf
>            Reporter: Allen Wittenauer
> Rather than distributing the hadoop configuration files to every data node, compute node,
etc, Hadoop should be able to read configuration information (dynamically!) from LDAP, ZooKeeper,

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message